-- Logs begin at Thu 2022-05-12 13:48:47 UTC, end at Thu 2022-05-12 15:09:15 UTC. -- May 12 14:28:27.742019 dv-cinder-840678-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 14:28:27.750176 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:28:27 2022] *** May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: nodename: dv-cinder-840678-8-iscsi May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: machine: x86_64 May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: clock source: unix May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: pcre jit disabled May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: detected number of CPU cores: 4 May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: current working directory: / May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: detected binary path: /usr/bin/uwsgi-core May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: your processes number limit is 47680 May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: your memory page size is 4096 bytes May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: detected max file descriptor number: 2048 May 12 14:28:27.752745 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: lock engine: pthread robust mutexes May 12 14:28:27.753539 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: thunder lock: enabled May 12 14:28:27.753539 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 14:28:27.753539 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:28:27.798823 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: Python main interpreter initialized at 0x55996ae139c0 May 12 14:28:27.798823 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: python threads support enabled May 12 14:28:27.798823 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: your server socket listen backlog is limited to 100 connections May 12 14:28:27.798823 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: your mercy for graceful operations on workers is 90 seconds May 12 14:28:27.799209 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:28:27.799209 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: *** Operational MODE: preforking *** May 12 14:28:27.799493 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: *** uWSGI is running in multiple interpreter mode *** May 12 14:28:27.799493 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: spawned uWSGI master process (pid: 102951) May 12 14:28:27.799726 dv-cinder-840678-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 14:28:27.801042 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: spawned uWSGI worker 1 (pid: 102952, cores: 1) May 12 14:28:27.801042 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: spawned uWSGI worker 2 (pid: 102953, cores: 1) May 12 14:28:27.801042 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:28:28.985964 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:28:29.006123 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:28:29.717910 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:28:29.717910 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: from cryptography.utils import int_from_bytes May 12 14:28:29.718249 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:28:29.718249 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: from cryptography.utils import int_from_bytes May 12 14:28:29.733959 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:28:29.733959 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: from cryptography.utils import int_from_bytes May 12 14:28:29.734290 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:28:29.734290 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: from cryptography.utils import int_from_bytes May 12 14:28:32.284868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:28:32.285472 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:28:32.285575 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:28:32.285970 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:28:32.286183 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:28:32.286594 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.286912 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.287234 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.287546 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.287898 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.288204 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.288525 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.288845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.289155 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.289409 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.289723 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.290045 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-8-iscsi {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.290362 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.290664 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.290971 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.291286 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.291704 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.292029 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.292127 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:28:32.292502 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.292586 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:28:32.292822 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.292985 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:28:32.294155 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:28:32.294324 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.294477 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:28:32.294606 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.294606 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.294854 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.294978 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.295104 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.295237 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.295364 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.295499 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.295621 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.296131 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.296269 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.296409 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.296539 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.296658 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.296799 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.296930 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297063 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297190 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-8-iscsi {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297328 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297328 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297575 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297703 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297830 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.297962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-8-iscsi {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.298107 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.298237 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.298368 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.298506 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.298636 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.298767 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.298900 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.299027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.299154 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.299282 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.299418 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.299540 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.299830 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.299983 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.300113 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.300113 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.300353 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.300502 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.300627 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.300755 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.300887 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301008 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301135 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301265 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301414 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301546 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301681 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301812 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.301945 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.302074 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.302257 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.302388 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.302537 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.302668 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.302876 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.303011 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.303189 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.303329 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.303513 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.303657 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-8-iscsi {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.303879 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.304021 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.304158 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.304282 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.304415 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.304546 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.304676 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.304903 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.305041 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.305209 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.305346 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.305530 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.305659 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.305826 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.305954 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.306139 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.306276 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.306430 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.306566 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.306733 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.306864 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.307088 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.307305 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.307512 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.307716 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.307847 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.307985 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.308109 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.308244 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.308369 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.308505 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.308637 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.308766 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.308970 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.309101 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.309364 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.309503 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.309630 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.309768 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310051 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310185 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310185 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310431 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310562 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310684 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.310927 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.311113 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.311247 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.311379 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.311502 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.311631 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.311789 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.311928 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.312106 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.312238 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.312362 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.312544 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.312684 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.312816 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.312947 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.313137 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.313266 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.313440 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.313576 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.313707 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.313836 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.314022 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.314161 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.314292 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.314423 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.314617 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.314747 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.314907 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.315035 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.315218 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.315356 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.315486 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.315608 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.315819 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.315950 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.316091 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.316227 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.316415 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.316557 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.316681 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.316803 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317008 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317140 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317263 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317385 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317566 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317696 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317836 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.317966 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.318149 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.318295 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.318450 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.318590 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.318785 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.318921 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.319044 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.319207 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.319336 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.319467 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.319649 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.319878 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.320164 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.320300 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.320431 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.320560 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.320694 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.320823 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.320946 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.321075 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.321198 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.321328 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.321461 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.321593 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.321725 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.321854 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.322041 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.322184 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.322319 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.322441 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.322696 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.322870 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.322996 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.323261 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.323455 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.323613 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.323771 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.323902 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.324088 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.324227 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.324402 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.324540 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.324702 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.324842 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.325027 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.325170 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.325301 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.325430 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.325591 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.325722 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.325888 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.326018 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.326189 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.326318 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.326471 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.326600 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.326794 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.326944 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.327098 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.327227 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.327414 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.327552 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.327706 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.327841 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.328016 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.328151 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.328331 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.328461 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.328628 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.328758 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.328956 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.329091 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.329254 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.329391 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.329557 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.329687 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.329886 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.330153 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.330291 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.330423 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.330556 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.330679 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.330808 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.330937 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.331058 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.331190 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.331366 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.331506 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.331664 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.331816 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.332020 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.332160 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.332317 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.332445 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.332628 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.332762 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.332917 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.333066 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.333221 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.333350 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.333557 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.333684 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.333872 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.334012 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.334174 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.334304 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.334494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.334623 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.334807 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.334947 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.335125 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.335259 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.335443 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.335570 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.335750 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.335876 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.336092 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.336223 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.336434 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.336575 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:28:32.336708 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.336831 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.337050 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.337210 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.337347 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.337478 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.337684 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.337809 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.337931 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.338121 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.338269 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.338549 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.339372 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.339482 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.339587 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.339718 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.339831 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.339956 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.340099 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.340371 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.340503 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.340638 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.340764 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.340896 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.340896 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.341135 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.341259 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.341382 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.341504 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.341636 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.341760 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.341887 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342009 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342140 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342272 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342405 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342528 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342651 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342773 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.342894 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.343024 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.343162 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.343345 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.343473 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.343595 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.343763 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.343907 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.344099 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.344228 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.344416 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.344548 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.344757 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.344896 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.345083 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.345212 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.345404 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.345536 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.345709 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.345848 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.346033 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.346163 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.346319 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.346449 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.346637 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.346776 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.346931 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.347061 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.347245 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.347375 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.347537 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.347669 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.347876 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.348006 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.348182 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.348312 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.348452 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.348576 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.348790 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.348919 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.349099 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.349229 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.349361 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.349492 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.349698 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.349837 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.349991 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.350120 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.350408 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.350586 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.350724 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.350851 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.350980 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.351113 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.351237 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.351367 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.351489 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.351611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.351752 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.351892 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.352088 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.352227 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.352380 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.352507 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.352687 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.352832 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.353021 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.353155 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.353331 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.353456 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.353634 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.353873 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.354025 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.354169 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.354353 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.354588 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.354725 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.354905 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.355034 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.355240 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.355365 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.355543 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.355680 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.355868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.356003 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.356153 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.356280 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.356457 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.356593 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.356754 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.356880 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.357052 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.357181 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.357348 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.357484 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.357646 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.357772 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.357943 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.358083 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.358260 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.358396 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.358562 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.358689 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.358860 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.358986 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.359158 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.359287 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.359454 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.359594 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.359799 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.359926 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.360103 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.360231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.360490 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.360618 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.360741 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.360863 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.360995 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.361120 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.361322 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.361450 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.361636 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.361772 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.361950 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.362077 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.362288 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.362415 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.362594 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.362728 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.362899 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.363026 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.363205 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.363342 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.363518 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.363663 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.363845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.363986 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.364162 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.364289 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.364470 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.364609 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.364778 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.364913 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.365080 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.365211 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.365383 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.365524 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.365678 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.365802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.365986 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.366112 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.366317 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.366441 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.366587 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.366720 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.366893 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.367019 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.367198 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.367325 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.367520 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.367647 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.367835 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.367971 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.368142 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.368277 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.368447 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.368574 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.368747 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.368872 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.369053 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.369180 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.369365 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.369557 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.369746 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.370013 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.370148 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.370317 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.370577 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.370710 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.370850 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.370984 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.371108 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.371238 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.371364 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.371494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.371630 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.371823 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.371954 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.372149 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.372277 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.372480 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.372615 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.372785 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.372914 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.373092 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.373227 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.373408 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.373543 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.373717 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.373844 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.374021 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.374148 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.374332 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.374469 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.374635 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.374774 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.374937 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.375064 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.375241 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.375377 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.375548 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.375675 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.375878 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.376005 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.376185 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.376332 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.376483 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.376610 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.376794 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.376928 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.377096 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.377232 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.377393 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.377520 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.377691 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.377817 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.377998 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.378126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.378313 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.378439 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.378619 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.378753 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.378936 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.379061 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.379249 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.379388 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.379544 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.379669 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.379867 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.380002 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.380184 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.380311 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.380488 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.380741 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.380884 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381016 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381221 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381347 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381469 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381600 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381724 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381846 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.381968 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.382090 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.382245 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.382382 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.382565 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.382693 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.382913 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.383045 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.383176 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.383309 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.383459 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.383596 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.383776 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.383901 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.384058 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.384200 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.384379 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.384514 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.384685 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.384811 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.384986 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.385145 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.385434 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.385560 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.385751 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.385977 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.386123 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.386317 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.386453 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.386642 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.386776 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.386945 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.387086 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.387252 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.387377 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.387557 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.387681 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.387882 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.388020 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.388188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.388315 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.388502 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.388630 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.388827 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.389068 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.389195 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.389396 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.389523 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.389708 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.389843 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.390022 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.390148 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.390339 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.390465 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.390648 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.390922 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.391053 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.391175 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.391298 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.391420 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.391582 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.391781 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.391918 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.392056 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.392209 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.392335 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.392512 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.392639 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.392881 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393036 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393161 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393291 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393428 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393566 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393698 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393823 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.393966 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.394092 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.394275 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.394417 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.394575 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.394702 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.394873 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.394999 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.395170 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.395306 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.395469 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.395596 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.395800 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.395928 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.396103 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.396251 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.396410 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.396537 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.396709 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.396836 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.397069 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.397212 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.397381 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.397507 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.397681 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.397806 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.397981 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.398117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.398281 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.398417 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.398620 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.398852 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.398988 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.399190 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.399324 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.399508 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.399634 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.399901 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.400045 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.400203 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.400329 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.400503 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.400654 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.400936 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.401074 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.401199 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.401490 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.401616 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.401858 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.401998 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.402175 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.402313 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.402481 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.402615 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.402780 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.402907 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.403086 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.403225 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.403388 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.403513 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.403717 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.403847 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.404025 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.404153 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.404325 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.404452 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.404631 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.404758 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.404931 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.405059 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.405236 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.405363 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.405538 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.405663 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.405834 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.405962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.406131 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.406265 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.406435 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.406571 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.406736 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.406870 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.407032 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.407159 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.407338 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.407473 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.407634 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.407784 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.407969 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.408099 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.408265 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.408404 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.408563 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.408689 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.408858 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.408979 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.409164 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.409300 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.409466 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.409606 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.409763 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.409930 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.410065 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.410278 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.410412 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.410590 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.410715 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411014 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411166 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411291 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411412 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411534 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411659 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411819 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.411956 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.412106 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.412233 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.412425 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.412552 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.412738 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.412872 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.413032 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.413157 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.413337 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.413463 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.413638 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.413772 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.413938 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.414064 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.414239 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.414366 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.414542 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.414668 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.414847 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.414971 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.415144 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.415270 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.415440 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.415570 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.415759 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.415888 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.416059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.416187 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.416417 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.416547 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.416778 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.417070 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.417196 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.417370 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.417496 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.417668 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.417794 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.418003 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.418127 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.418300 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.418427 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.418623 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.418749 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.418936 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.419064 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.419268 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.419396 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.419541 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.419666 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.419869 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.419995 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.420176 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.420311 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.420486 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.420612 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.421231 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.421380 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.421506 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.421636 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.421766 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.421890 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.422019 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.422156 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.422311 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.422447 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.422608 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.422743 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.422923 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.423060 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.423235 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.423361 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.423565 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.423747 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.423909 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.424048 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.424215 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.424340 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.424529 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.424655 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.424828 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.424953 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.425133 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.425259 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.425437 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.425561 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.425739 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.425866 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.426039 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.426173 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.426337 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.426469 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.426638 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.426763 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.426942 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.427076 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.427253 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.427388 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.427577 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.427736 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.427903 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.428028 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.428206 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.428346 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.428510 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.428643 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.428810 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.428935 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.429105 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.429243 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.429426 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.429554 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.429729 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.429867 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.430030 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.430165 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.430335 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.430464 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.430632 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.430759 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.430937 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.431073 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.431339 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.431483 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.431616 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.431800 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.431992 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.432121 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.432363 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.432547 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.432674 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.432913 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.433048 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.433237 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.433364 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.433544 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.433671 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.433850 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.433990 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.434150 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.434278 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.434552 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.434686 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.434858 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.434998 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.435168 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.435295 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.435471 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.435597 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.435790 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.435931 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.436088 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.436214 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.436398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.436525 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.436707 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.436836 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.437003 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.437130 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.437305 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.437431 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.437601 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.437736 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.437915 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.438042 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.438217 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.438352 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.438530 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.438656 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.438843 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.438971 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.439155 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.439275 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.439464 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.439591 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.439801 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.439930 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.440116 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.440266 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.440423 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.440556 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.440753 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.440880 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.441068 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.441203 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.441467 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.441605 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.441729 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.441854 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.441985 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.442118 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.442267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.442394 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.442572 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.442699 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.442887 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.443031 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.443241 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.443400 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.443526 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.443649 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.443820 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.443946 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.444115 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.444243 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.444440 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.444566 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.444758 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.444885 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.445073 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.445201 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.445410 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.445534 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.445788 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.445913 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.446095 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.446223 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.446410 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.446536 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.446728 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.446854 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.447024 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.447149 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.447322 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.447481 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.447661 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.447878 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.448017 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.448270 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.448454 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.448589 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.448779 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.448920 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.449095 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.449222 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.449408 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.449543 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.449737 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.449873 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.450049 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.450176 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.450345 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.450471 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.450664 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.450800 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.450964 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.451091 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.451283 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.451410 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.451679 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.451839 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.451973 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.452106 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.452230 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.452414 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.452552 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.452740 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.452867 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.453066 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.453201 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.453381 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.453515 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.453682 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.453809 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.453981 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.454115 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.454291 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.454430 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.454609 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.454747 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.454924 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.455051 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.455235 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.455369 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.455555 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.455716 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.455888 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.456016 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.456221 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.456349 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.456540 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.456678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.456852 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.456979 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.457165 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.457293 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.457486 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.457613 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.457785 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.457919 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.458083 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.458211 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.458389 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.458516 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.458689 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.458817 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.458991 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.459117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.459272 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.459399 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.459574 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.459781 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.459918 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.460042 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.460175 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.460299 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.460465 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.460603 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.460783 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.460920 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.461083 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.461210 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.461399 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.461535 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.461807 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.461934 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.462058 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.462189 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.462313 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.462448 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.462573 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.462697 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.462878 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.463007 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.463206 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.463343 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.463534 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.463871 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.464066 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.464199 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.464335 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.464502 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.464630 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.464806 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.464941 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.465125 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.465262 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.465441 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.465576 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.465752 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.465881 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.466061 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.466266 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.466392 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.466515 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.466670 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.466805 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.466981 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.467110 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.467291 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.467418 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.467597 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.467744 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.467934 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.468072 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.468245 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.468373 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.468555 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.468682 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.468897 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.469064 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.469198 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.469386 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.469513 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.469697 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.469833 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.470004 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.470132 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.470311 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.470440 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.470620 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.470748 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.470928 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.471055 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.471233 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.471369 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.471540 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.471833 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.471971 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.472095 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.472218 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.472342 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.472481 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.472607 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.472785 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.472920 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.473108 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.473311 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.473445 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.473748 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.473748 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.473970 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.474078 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.474210 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.474335 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.474458 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.474629 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.474755 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.474982 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.475123 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.475290 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.475418 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.475590 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.475772 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.475912 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.476038 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.476222 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.476348 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.476529 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.476657 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.476834 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.476962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.477138 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.477265 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.477446 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.477573 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.477756 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.477890 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.478061 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.478188 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.478365 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.478501 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.478673 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.478868 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.479038 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.479227 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.479439 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.479664 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.479853 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.479980 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.480102 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.480297 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.480424 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.480606 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.480735 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.480913 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.481049 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.481332 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.481465 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.481716 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.481994 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.482126 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.482250 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.482380 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.482514 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.482664 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.482791 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.483027 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.483185 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.483311 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.483443 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.483592 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.483770 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.483925 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.484052 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.484234 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.484377 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.484543 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.484670 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.484848 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.484977 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.485146 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.485274 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.485461 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.485588 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.485764 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.485903 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.486063 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.486207 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.486377 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.486504 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.486680 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.486808 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.487054 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.487206 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.487374 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.487549 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.487760 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.487911 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.488081 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.488209 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.488402 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.488537 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.488721 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.488857 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.489036 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.489163 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.489354 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.489488 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.489668 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.489798 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490081 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490217 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490350 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490481 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490614 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490739 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490869 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.490993 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.491139 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.491267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.491445 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.491573 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.491769 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.491898 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.492141 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.492405 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.492550 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.492684 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.492815 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.492970 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.493123 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.493251 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.493384 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.493517 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.493640 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.493763 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.493893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.494105 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.494231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.494444 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.494643 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.494826 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.495011 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.495150 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.495433 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.495566 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.495730 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.495850 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.495988 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.496181 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.496310 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.496491 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.496618 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.496797 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.496923 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.497095 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.497224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.497400 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.497527 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.497718 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.497854 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.498032 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.498159 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.498343 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.498470 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.498640 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.498775 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.498949 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.499076 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.499254 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.499387 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.499571 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.499749 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.499903 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.500032 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.500274 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.500438 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.500566 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.500795 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.500924 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.501119 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.501337 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.501466 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.501665 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.501795 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.501978 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.502118 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.502339 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.502475 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.502676 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.502803 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.502927 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.503049 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.503179 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.503303 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.503461 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.503601 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.503796 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.503941 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.504109 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.504250 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.504415 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.504579 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.504702 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.504826 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.505010 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.505146 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.505313 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.505440 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.505617 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.505753 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.505920 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.506058 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.506224 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.506358 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.506525 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.506653 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.506826 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.506964 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.507129 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.507256 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.507431 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.507558 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.507747 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.507874 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.508078 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.508208 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.508387 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.508514 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.508691 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.508819 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.508997 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.509133 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.509302 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.509428 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.509600 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.509739 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.509902 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.510107 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.510240 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.510493 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.510652 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.510826 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.510953 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.511147 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.511274 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.511454 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.511581 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.511787 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.511916 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.512144 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.512298 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.512498 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.512626 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.512756 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.512888 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.513062 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.513190 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.513387 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.513513 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.513699 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.513825 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.514015 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.514151 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.514325 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.514459 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.514647 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.514775 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.514953 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.515190 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.515327 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.515526 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.515660 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.515877 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.516017 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.516219 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.516348 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.516529 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.516655 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.516831 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.516972 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.517130 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.517258 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.517437 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.517565 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.517748 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.517886 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.518056 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.518184 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.518355 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.518482 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.518653 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.518790 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.518958 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.519085 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.519261 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.519392 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.519561 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.519726 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.519886 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.520021 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.520186 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.520313 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.520534 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.520672 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.520795 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.520925 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.521070 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.521205 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.521367 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.521501 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.521665 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.521801 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.521962 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.522089 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.522260 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.522388 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.522588 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.522722 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.522845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.522973 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.523141 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.523278 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.523443 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.523570 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.523763 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.523907 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.524069 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.524197 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.524396 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.524523 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.524724 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.524864 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.525035 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.525162 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.525353 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.525479 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.525679 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.525842 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.526034 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.526294 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.526490 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.526620 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.526753 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.526905 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.527034 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.527212 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.527339 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.527515 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.527652 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.527869 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.528000 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.528178 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.528318 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.528496 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.528639 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.528806 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.528934 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.529113 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.529240 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.529419 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.529555 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.529724 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.529851 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.530046 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.530166 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.530368 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.530512 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.530722 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.530849 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.530972 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.531095 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.531299 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.531433 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.531557 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.531740 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.531883 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.532018 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.532189 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.532317 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.532511 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.532662 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.532851 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.532990 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.533116 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.533240 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.533402 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.533530 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.533703 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.533840 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.533997 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.534122 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.534295 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.534432 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.534607 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.534744 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.534961 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.535098 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.535222 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.535346 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.535542 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.535669 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.535891 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.536018 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.536233 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.536359 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.536539 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.536667 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.536850 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.536976 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.537157 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.537292 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.537465 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.537592 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.537772 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.537927 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.538052 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.538180 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.538314 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:28:32.538447 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.538688 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.539023 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.539338 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.539660 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.539999 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.540322 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.540635 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.540959 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.541456 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.541905 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.542430 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.542778 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.543100 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.543420 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.543767 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.544088 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.544405 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.544722 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.545055 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.545383 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.545694 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.546361 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.546681 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.547007 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.547328 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.547644 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.548003 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.548320 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.548634 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.548952 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.549266 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.549580 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.549898 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.550217 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.550547 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.550882 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.551211 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.551540 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.551914 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.552375 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.552727 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.553059 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.553373 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.553688 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.553996 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:28:32.554240 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:28:32.563124 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_db.sqlalchemy.engines [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:32.579093 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_db.sqlalchemy.engines [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:32.625676 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.context [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b6a5814-8930-4726-ad38-75a9ded38aa1(cell1) {{(pid=102952) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:28:32.630043 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_concurrency.lockutils [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:28:32.631619 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_concurrency.lockutils [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:28:32.632406 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_concurrency.lockutils [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:28:32.634306 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_concurrency.lockutils [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:28:32.643116 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.context [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b6a5814-8930-4726-ad38-75a9ded38aa1(cell1) {{(pid=102953) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:28:32.645576 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_db.sqlalchemy.engines [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:32.647553 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:28:32.649214 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:28:32.649347 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_db.sqlalchemy.engines [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:32.650020 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:28:32.652487 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:28:32.665432 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_db.sqlalchemy.engines [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:32.669263 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_db.sqlalchemy.engines [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:32.808076 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG oslo_db.sqlalchemy.engines [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:32.834853 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_db.sqlalchemy.engines [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:28:33.145603 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: WARNING keystonemiddleware.auth_token [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:28:33.153171 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: WARNING keystonemiddleware.auth_token [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:28:33.159720 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: WARNING keystonemiddleware.auth_token [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:28:33.167255 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: WARNING keystonemiddleware.auth_token [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:28:33.500835 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: WARNING keystonemiddleware.auth_token [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:28:33.506987 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: WARNING keystonemiddleware.auth_token [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:28:33.512279 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55996ae139c0 pid: 102953 (default app) May 12 14:28:33.513466 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: WARNING keystonemiddleware.auth_token [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:28:33.514302 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:28:33.515474 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 May 12 14:28:33.515910 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Thu May 12 14:28:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:28:33.519582 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: WARNING keystonemiddleware.auth_token [None req-7a080f62-2d56-4f27-bf83-34a2875dbd39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:28:33.525873 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55996ae139c0 pid: 102952 (default app) May 12 14:29:52.530489 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:52.531482 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 12 14:29:52.531891 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:29:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:29:52.974151 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-65a30058-f6ab-4304-a6d5-cdd787e01f97 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:53.005705 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-65a30058-f6ab-4304-a6d5-cdd787e01f97 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.466904 May 12 14:29:53.006601 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1291 bytes} [Thu May 12 14:29:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:29:55.242763 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:55.244492 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-ca20a3ec-51c7-4ca3-a38c-dda9727d46fb None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 May 12 14:29:55.244873 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:29:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:29:55.302894 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-de7e6e98-d1d0-4a27-98cf-bfa1817c4d98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:29:55.320893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:55.320893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: warnings.warn(msg) May 12 14:29:55.349746 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-de7e6e98-d1d0-4a27-98cf-bfa1817c4d98 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.099022 May 12 14:29:55.350306 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:29:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:29:55.564853 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-4675b29d-09e3-4a22-8637-4bd3616c707f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:29:55.567167 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:55.567167 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: warnings.warn(msg) May 12 14:29:55.616162 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-4675b29d-09e3-4a22-8637-4bd3616c707f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257736 May 12 14:29:55.617053 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1335 bytes} [Thu May 12 14:29:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:29:57.876189 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-de7e6e98-d1d0-4a27-98cf-bfa1817c4d98 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:57.877209 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-de7e6e98-d1d0-4a27-98cf-bfa1817c4d98 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 12 14:29:57.877618 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:29:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:29:57.991032 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-35686b7d-6804-434d-a053-ea817582dee1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "ram": 512, "vcpus": 1, "name": "ds512M"}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:29:58.015123 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:58.015123 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: warnings.warn(msg) May 12 14:29:58.043842 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-35686b7d-6804-434d-a053-ea817582dee1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160133 May 12 14:29:58.044409 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:29:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:29:58.057966 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-411da540-eaca-465f-8424-490fe900449e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:29:58.059579 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:58.059579 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: warnings.warn(msg) May 12 14:29:58.093007 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-411da540-eaca-465f-8424-490fe900449e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039721 May 12 14:29:58.103711 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1335 bytes} [Thu May 12 14:29:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:00.346679 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-35686b7d-6804-434d-a053-ea817582dee1 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:00.347715 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-35686b7d-6804-434d-a053-ea817582dee1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 12 14:30:00.348329 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:00.407574 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-ce28852a-4593-4a50-95fc-d72e5c2240df admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:00.428167 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-ce28852a-4593-4a50-95fc-d72e5c2240df admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073882 May 12 14:30:00.428876 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:30:00.441099 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-ef85de93-8110-4c4e-858e-7a0061b21673 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:00.465010 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-ef85de93-8110-4c4e-858e-7a0061b21673 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027665 May 12 14:30:00.465958 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1335 bytes} [Thu May 12 14:30:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:02.741507 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-ce28852a-4593-4a50-95fc-d72e5c2240df admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:02.742486 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-ce28852a-4593-4a50-95fc-d72e5c2240df admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 12 14:30:02.751962 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:02.811148 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-f9c57d74-2814-43cb-9fb5-f13164aeeb64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:02.832084 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-f9c57d74-2814-43cb-9fb5-f13164aeeb64 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078463 May 12 14:30:02.832656 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:02.845821 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-f329693e-3119-485e-8c92-cc912613d4a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:02.873531 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-f329693e-3119-485e-8c92-cc912613d4a1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031618 May 12 14:30:02.874059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1335 bytes} [Thu May 12 14:30:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:05.201666 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-f9c57d74-2814-43cb-9fb5-f13164aeeb64 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:05.202675 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-f9c57d74-2814-43cb-9fb5-f13164aeeb64 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 12 14:30:05.203077 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:05.265533 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-083ccbfc-1769-494c-8030-6d474141d9b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "id": "d4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:05.285789 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-083ccbfc-1769-494c-8030-6d474141d9b5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076650 May 12 14:30:05.286789 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:30:05.299300 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-9767ee9f-b4c5-47f1-a8b2-096500f5baec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:05.323398 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-9767ee9f-b4c5-47f1-a8b2-096500f5baec admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028340 May 12 14:30:05.324711 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1335 bytes} [Thu May 12 14:30:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:07.581445 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-083ccbfc-1769-494c-8030-6d474141d9b5 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:07.582504 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-083ccbfc-1769-494c-8030-6d474141d9b5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 12 14:30:07.583090 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:07.648117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-8e02b510-5cd6-4e8e-994e-d3701dfb3e6a admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:07.682218 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-8e02b510-5cd6-4e8e-994e-d3701dfb3e6a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092214 May 12 14:30:07.683287 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1291 bytes} [Thu May 12 14:30:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:09.982191 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-083ccbfc-1769-494c-8030-6d474141d9b5 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:09.983316 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-083ccbfc-1769-494c-8030-6d474141d9b5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 May 12 14:30:09.983712 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:10.046199 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-10f58413-7128-4a19-950a-3ef469dff322 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 1, "swap": 0}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:10.068704 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-10f58413-7128-4a19-950a-3ef469dff322 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078318 May 12 14:30:10.069380 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:30:10.082870 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-a09d0c90-3425-4c64-b68e-f411428e8a45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:10.108363 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-a09d0c90-3425-4c64-b68e-f411428e8a45 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029698 May 12 14:30:10.108986 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1332 bytes} [Thu May 12 14:30:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:12.458510 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-10f58413-7128-4a19-950a-3ef469dff322 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:12.459493 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-10f58413-7128-4a19-950a-3ef469dff322 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 12 14:30:12.459973 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:12.519918 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-62f7b502-087c-44e1-b08e-9512be34c366 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "ram": 2048, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:12.538738 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-62f7b502-087c-44e1-b08e-9512be34c366 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072555 May 12 14:30:12.539293 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:12.552145 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-99f2498b-8a7d-4fce-9ab5-391dc08c41ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:12.581337 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-99f2498b-8a7d-4fce-9ab5-391dc08c41ab admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033335 May 12 14:30:12.581987 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1332 bytes} [Thu May 12 14:30:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:14.831226 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-62f7b502-087c-44e1-b08e-9512be34c366 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:14.832353 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-62f7b502-087c-44e1-b08e-9512be34c366 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 May 12 14:30:14.832959 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:14.894895 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-6fbaa75a-c25b-4754-b7fc-2dbcef042a00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:14.915971 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-6fbaa75a-c25b-4754-b7fc-2dbcef042a00 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075194 May 12 14:30:14.916540 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:14.928843 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-5fef4a4c-9bff-44c6-8476-ec53e066b104 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:14.953333 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-5fef4a4c-9bff-44c6-8476-ec53e066b104 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028146 May 12 14:30:14.953924 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1332 bytes} [Thu May 12 14:30:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:17.224865 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-6fbaa75a-c25b-4754-b7fc-2dbcef042a00 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:17.225901 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-6fbaa75a-c25b-4754-b7fc-2dbcef042a00 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 12 14:30:17.226307 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:17.286526 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-f4b50fe7-4399-4b52-8178-a0a505f8e1e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:17.306114 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-f4b50fe7-4399-4b52-8178-a0a505f8e1e8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073126 May 12 14:30:17.306698 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:17.322312 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-ca421931-af37-41cf-9fe1-9f650a591c25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:17.349055 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-ca421931-af37-41cf-9fe1-9f650a591c25 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030604 May 12 14:30:17.349769 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1332 bytes} [Thu May 12 14:30:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:30:19.677756 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-f4b50fe7-4399-4b52-8178-a0a505f8e1e8 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:19.679233 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-f4b50fe7-4399-4b52-8178-a0a505f8e1e8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 May 12 14:30:19.685694 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:19.759344 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-921b20b4-51d5-41e9-ba29-131dd1e84261 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:19.788022 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-921b20b4-51d5-41e9-ba29-131dd1e84261 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.100017 May 12 14:30:19.789170 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1282 bytes} [Thu May 12 14:30:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:19.801588 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-891895f7-754d-4f4b-8418-50875b086c5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:19.835526 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-891895f7-754d-4f4b-8418-50875b086c5b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037334 May 12 14:30:19.838230 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1332 bytes} [Thu May 12 14:30:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:30:43.987574 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-921b20b4-51d5-41e9-ba29-131dd1e84261 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:43.988643 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-921b20b4-51d5-41e9-ba29-131dd1e84261 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 May 12 14:30:43.989031 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:44.055804 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-c4f645b3-b33e-446a-89be-a9c373768e1c admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:44.074170 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-c4f645b3-b33e-446a-89be-a9c373768e1c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078679 May 12 14:30:44.074648 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1291 bytes} [Thu May 12 14:30:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:45.190067 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-921b20b4-51d5-41e9-ba29-131dd1e84261 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:45.191062 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-921b20b4-51d5-41e9-ba29-131dd1e84261 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 12 14:30:45.191464 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:45.412305 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-e9340dfd-c6c2-4cc5-b590-aa244d38d05c admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:45.418256 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.wsgi [None req-e9340dfd-c6c2-4cc5-b590-aa244d38d05c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-e9340dfd-c6c2-4cc5-b590-aa244d38d05c admin admin] Request method failure captured: May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Accept: application/json May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Accept-Encoding: gzip, deflate May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Connection: keep-alive May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Content-Length: 0 May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Host: 10.222.0.79 May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Openstack-Api-Version: compute 2.90 May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Openstack-System-Scope: None May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: User-Agent: python-novaclient May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Auth-Token: gAAAAABifRoVKG4yMlOj5llw_qdmv-g6Rz09X7aCkv0x7n8CvwjiiGW8_9-jGqbS4u8MhPDQmnzIn_e19QmzVe3XWBIoBLMX_nJDaTauW1LPPkeEP24LRgiP0JyPutQBOMBDO_l2udZKBhjbZ4gnQog4BP7kaEMxWXt24SgTzYyDr_jNoGN6wVs May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Domain-Id: None May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Domain-Name: None May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Identity-Status: Confirmed May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Is-Admin-Project: True May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Domain-Id: default May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Domain-Name: Default May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Name: admin May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Role: reader,admin,member May 12 14:30:45.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Roles: reader,admin,member May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da529673a2b348db8fa8b2ebc5773804", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant: admin May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant-Name: admin May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User: admin May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Domain-Id: default May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Domain-Name: Default May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Id: fa9ac61b8632465586bee816b0404515 May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Name: admin May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: method: > May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: exception: Flavor 42 could not be found. May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: action_args: {'id': '42'} May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:30:45.423294 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:45.424768 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:45.426494 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-e9340dfd-c6c2-4cc5-b590-aa244d38d05c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:30:45.428329 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-e9340dfd-c6c2-4cc5-b590-aa244d38d05c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073716 May 12 14:30:45.428329 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Thu May 12 14:30:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:30:45.437111 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-fb027d5d-81e5-48f3-af89-039e77d12c26 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:45.458016 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-fb027d5d-81e5-48f3-af89-039e77d12c26 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027002 May 12 14:30:45.458560 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Thu May 12 14:30:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:45.469210 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-14f70a49-0656-4c09-b7fa-12b024ca7679 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:45.490391 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-14f70a49-0656-4c09-b7fa-12b024ca7679 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025084 May 12 14:30:45.490940 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Thu May 12 14:30:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:45.502900 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-132e4ba8-3ae4-4385-865a-30722c14704d admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:45.511749 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.wsgi [None req-132e4ba8-3ae4-4385-865a-30722c14704d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-132e4ba8-3ae4-4385-865a-30722c14704d admin admin] Request method failure captured: May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Accept: application/json May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Accept-Encoding: gzip, deflate May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Connection: keep-alive May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Content-Length: 0 May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Host: 10.222.0.79 May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Openstack-Api-Version: compute 2.90 May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Openstack-System-Scope: None May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: User-Agent: python-novaclient May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Auth-Token: gAAAAABifRoVKG4yMlOj5llw_qdmv-g6Rz09X7aCkv0x7n8CvwjiiGW8_9-jGqbS4u8MhPDQmnzIn_e19QmzVe3XWBIoBLMX_nJDaTauW1LPPkeEP24LRgiP0JyPutQBOMBDO_l2udZKBhjbZ4gnQog4BP7kaEMxWXt24SgTzYyDr_jNoGN6wVs May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Domain-Id: None May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Domain-Name: None May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Identity-Status: Confirmed May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Is-Admin-Project: True May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Domain-Id: default May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Domain-Name: Default May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Name: admin May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Role: reader,admin,member May 12 14:30:45.517267 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Roles: reader,admin,member May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da529673a2b348db8fa8b2ebc5773804", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant: admin May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant-Name: admin May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User: admin May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Domain-Id: default May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Domain-Name: Default May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Id: fa9ac61b8632465586bee816b0404515 May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Name: admin May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: method: > May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: exception: Flavor 42 could not be found. May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: action_args: {'id': '42'} May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:30:45.519611 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:45.520802 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:45.522126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-132e4ba8-3ae4-4385-865a-30722c14704d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:30:45.523355 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-132e4ba8-3ae4-4385-865a-30722c14704d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.022365 May 12 14:30:45.523355 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Thu May 12 14:30:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:30:46.435642 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-14f70a49-0656-4c09-b7fa-12b024ca7679 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:46.436792 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-14f70a49-0656-4c09-b7fa-12b024ca7679 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 May 12 14:30:46.437221 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:46.635809 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-5e7b247e-b7d0-4971-9097-a8ae3023f28d admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:46.641241 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.wsgi [None req-5e7b247e-b7d0-4971-9097-a8ae3023f28d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-5e7b247e-b7d0-4971-9097-a8ae3023f28d admin admin] Request method failure captured: May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Accept: application/json May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Accept-Encoding: gzip, deflate May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Connection: keep-alive May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Content-Length: 0 May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Host: 10.222.0.79 May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Openstack-Api-Version: compute 2.90 May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Openstack-System-Scope: None May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: User-Agent: python-novaclient May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Auth-Token: gAAAAABifRoWnatktMCoD4N97vSSuRad9ztpScUjK1g1uGSC4no7cXlM-SShIW4MWJ0y72Llaoey6eH-NnDWaMUXwGzGbT3UBkSogM4eXRChfA3_LQMfK_0o7vu-Zl0OOh47bylRDm2It14qyUEtTbIbwjPRgr2Y3S9c_I0-TMk38_w3zFtn_WI May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Domain-Id: None May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Domain-Name: None May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Identity-Status: Confirmed May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Is-Admin-Project: True May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Domain-Id: default May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Domain-Name: Default May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Name: admin May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Role: reader,admin,member May 12 14:30:46.642720 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Roles: reader,admin,member May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da529673a2b348db8fa8b2ebc5773804", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant: admin May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant-Name: admin May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User: admin May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Domain-Id: default May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Domain-Name: Default May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Id: fa9ac61b8632465586bee816b0404515 May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Name: admin May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: method: > May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: exception: Flavor 84 could not be found. May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: action_args: {'id': '84'} May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:30:46.644231 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:46.645027 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:46.646037 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-5e7b247e-b7d0-4971-9097-a8ae3023f28d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:30:46.647126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-5e7b247e-b7d0-4971-9097-a8ae3023f28d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067960 May 12 14:30:46.647126 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Thu May 12 14:30:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:30:46.654201 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-a93abd84-fe7d-4b78-9ab3-7d9cb7f9aec9 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:46.668426 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-a93abd84-fe7d-4b78-9ab3-7d9cb7f9aec9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017851 May 12 14:30:46.668932 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Thu May 12 14:30:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:46.681854 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-d8e44140-13bb-4c02-a634-58a18d59f048 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:46.700761 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-d8e44140-13bb-4c02-a634-58a18d59f048 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025081 May 12 14:30:46.701329 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Thu May 12 14:30:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:46.710506 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-19f3c75b-9709-42a8-a484-4ea6176a8392 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:46.715897 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.wsgi [None req-19f3c75b-9709-42a8-a484-4ea6176a8392 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-19f3c75b-9709-42a8-a484-4ea6176a8392 admin admin] Request method failure captured: May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Accept: application/json May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Accept-Encoding: gzip, deflate May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Connection: keep-alive May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Content-Length: 0 May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Host: 10.222.0.79 May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Openstack-Api-Version: compute 2.90 May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Openstack-System-Scope: None May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: User-Agent: python-novaclient May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Auth-Token: gAAAAABifRoWnatktMCoD4N97vSSuRad9ztpScUjK1g1uGSC4no7cXlM-SShIW4MWJ0y72Llaoey6eH-NnDWaMUXwGzGbT3UBkSogM4eXRChfA3_LQMfK_0o7vu-Zl0OOh47bylRDm2It14qyUEtTbIbwjPRgr2Y3S9c_I0-TMk38_w3zFtn_WI May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Domain-Id: None May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Domain-Name: None May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Identity-Status: Confirmed May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Is-Admin-Project: True May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Domain-Id: default May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Domain-Name: Default May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Name: admin May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Role: reader,admin,member May 12 14:30:46.717398 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Roles: reader,admin,member May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da529673a2b348db8fa8b2ebc5773804", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant: admin May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant-Name: admin May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User: admin May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Domain-Id: default May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Domain-Name: Default May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Id: fa9ac61b8632465586bee816b0404515 May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Name: admin May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: method: > May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: exception: Flavor 84 could not be found. May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: action_args: {'id': '84'} May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:30:46.718845 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:46.719849 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:46.721059 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-19f3c75b-9709-42a8-a484-4ea6176a8392 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:30:46.722331 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-19f3c75b-9709-42a8-a484-4ea6176a8392 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011718 May 12 14:30:46.722331 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Thu May 12 14:30:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:30:47.621525 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-d8e44140-13bb-4c02-a634-58a18d59f048 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:47.622541 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-d8e44140-13bb-4c02-a634-58a18d59f048 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 12 14:30:47.622950 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:47.818615 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-f0167d77-e803-45f7-a82e-ecce79c07d7f admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:47.824802 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.wsgi [None req-f0167d77-e803-45f7-a82e-ecce79c07d7f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-f0167d77-e803-45f7-a82e-ecce79c07d7f admin admin] Request method failure captured: May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Accept: application/json May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Accept-Encoding: gzip, deflate May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Connection: keep-alive May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Content-Length: 0 May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Host: 10.222.0.79 May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Openstack-Api-Version: compute 2.90 May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Openstack-System-Scope: None May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: User-Agent: python-novaclient May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Auth-Token: gAAAAABifRoX195t3Q6Fmwyof2JDSbnkkWUw8bg2GcmkogRyyxwmfB56YMrbKX3z5bRe5PkKxOKUE1yKefgNvBrwArMv7pm9q13a764a8iwmrp6-ZDQJqV9xWA9hEWSiwjKMqMRQwWCKY0loAQPVIEfIjOTPCUaWc0dT7kUVsgL3RjooBVjWze4 May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Domain-Id: None May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Domain-Name: None May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Identity-Status: Confirmed May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Is-Admin-Project: True May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Domain-Id: default May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Domain-Name: Default May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Project-Name: admin May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Role: reader,admin,member May 12 14:30:47.826326 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Roles: reader,admin,member May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da529673a2b348db8fa8b2ebc5773804", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant: admin May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-Tenant-Name: admin May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User: admin May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Domain-Id: default May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Domain-Name: Default May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Id: fa9ac61b8632465586bee816b0404515 May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: X-User-Name: admin May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: method: > May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: exception: Flavor 451 could not be found. May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: action_args: {'id': '451'} May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:30:47.827893 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:47.828868 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: ERROR nova.api.openstack.wsgi May 12 14:30:47.830188 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-f0167d77-e803-45f7-a82e-ecce79c07d7f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:30:47.831483 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-f0167d77-e803-45f7-a82e-ecce79c07d7f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066975 May 12 14:30:47.831483 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Thu May 12 14:30:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:30:47.837820 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-01ea10a3-5857-4487-bdf3-9a3f06198cc7 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:47.852976 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-01ea10a3-5857-4487-bdf3-9a3f06198cc7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018783 May 12 14:30:47.853514 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Thu May 12 14:30:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:47.863397 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:47.877182 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017437 May 12 14:30:47.877679 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Thu May 12 14:30:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:47.887299 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-2e23b110-4b46-4bf2-a101-e754bd5108a3 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:47.893177 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.wsgi [None req-2e23b110-4b46-4bf2-a101-e754bd5108a3 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-2e23b110-4b46-4bf2-a101-e754bd5108a3 admin admin] Request method failure captured: May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Accept: application/json May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Accept-Encoding: gzip, deflate May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Connection: keep-alive May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Content-Length: 0 May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Host: 10.222.0.79 May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Openstack-Api-Version: compute 2.90 May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Openstack-System-Scope: None May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: User-Agent: python-novaclient May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Auth-Token: gAAAAABifRoX195t3Q6Fmwyof2JDSbnkkWUw8bg2GcmkogRyyxwmfB56YMrbKX3z5bRe5PkKxOKUE1yKefgNvBrwArMv7pm9q13a764a8iwmrp6-ZDQJqV9xWA9hEWSiwjKMqMRQwWCKY0loAQPVIEfIjOTPCUaWc0dT7kUVsgL3RjooBVjWze4 May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Domain-Id: None May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Domain-Name: None May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Identity-Status: Confirmed May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Is-Admin-Project: True May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Domain-Id: default May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Domain-Name: Default May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Project-Name: admin May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Role: reader,admin,member May 12 14:30:47.894678 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Roles: reader,admin,member May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da529673a2b348db8fa8b2ebc5773804", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da529673a2b348db8fa8b2ebc5773804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant: admin May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant-Id: da529673a2b348db8fa8b2ebc5773804 May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-Tenant-Name: admin May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User: admin May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Domain-Id: default May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Domain-Name: Default May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Id: fa9ac61b8632465586bee816b0404515 May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: X-User-Name: admin May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: method: > May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: exception: Flavor 451 could not be found. May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: action_args: {'id': '451'} May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:30:47.896117 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:47.897224 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: ERROR nova.api.openstack.wsgi May 12 14:30:47.898962 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-2e23b110-4b46-4bf2-a101-e754bd5108a3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:30:47.900310 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-2e23b110-4b46-4bf2-a101-e754bd5108a3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012626 May 12 14:30:47.900310 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Thu May 12 14:30:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:30:48.790828 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:48.791855 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 12 14:30:48.792257 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:48.994184 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-3ba1d20b-8f91-4932-84d0-3f3bc1a674f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:49.016507 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-3ba1d20b-8f91-4932-84d0-3f3bc1a674f1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.077356 May 12 14:30:49.016985 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Thu May 12 14:30:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:49.907089 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:49.908159 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 12 14:30:49.908553 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:50.105976 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-f29fb950-c3f0-45f8-b246-913ce8df37a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:50.126804 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-f29fb950-c3f0-45f8-b246-913ce8df37a5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.082210 May 12 14:30:50.127346 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Thu May 12 14:30:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:51.021852 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:51.023021 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 May 12 14:30:51.023425 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:51.222961 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-365f387f-d4dd-4434-93af-e8608dccca09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:51.241993 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-365f387f-d4dd-4434-93af-e8608dccca09 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.080044 May 12 14:30:51.242556 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Thu May 12 14:30:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:52.138885 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:52.139934 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 12 14:30:52.140333 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:52.344939 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-8b19bba1-b13a-4167-b1ad-539e7f61159f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:30:52.364897 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-8b19bba1-b13a-4167-b1ad-539e7f61159f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.089284 May 12 14:30:52.365637 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Thu May 12 14:30:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:30:53.253416 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:53.254446 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 12 14:30:53.254820 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:30:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:30:53.467380 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-2c52ca3a-c128-4152-9354-26f07502b194 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:30:53.487135 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-2c52ca3a-c128-4152-9354-26f07502b194 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.089660 May 12 14:30:53.487660 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Thu May 12 14:30:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:56.039408 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.040466 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-dff7faca-c46d-4fab-b7a7-f7b4f6491d95 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 12 14:31:56.040871 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 930 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:56.110196 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-b84d414a-b072-4246-a4ad-a990eda3eee0 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.130052 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-b84d414a-b072-4246-a4ad-a990eda3eee0 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.082395 May 12 14:31:56.130590 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1291 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:56.153373 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-23b33ddc-92a9-4ef2-8d89-b6a85ef69a23 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.161338 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-23b33ddc-92a9-4ef2-8d89-b6a85ef69a23 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012208 May 12 14:31:56.161862 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1282 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:56.176370 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-1dba4aed-0b43-419c-ad4f-9319d4bfd57a admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.189577 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-1dba4aed-0b43-419c-ad4f-9319d4bfd57a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019259 May 12 14:31:56.190452 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1285 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:56.206082 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.214686 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014236 May 12 14:31:56.215237 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1285 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:56.227374 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-162cfd80-ef1a-4016-bc5e-45e43c268e7e admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.235843 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-162cfd80-ef1a-4016-bc5e-45e43c268e7e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012463 May 12 14:31:56.236383 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1282 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:25.244948 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:25.246243 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 May 12 14:35:25.246781 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:35:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:25.521111 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-723eade0-98c7-4ffc-a658-8b03aab6e0a8 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:25.522328 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:35:25.522328 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: warnings.warn(msg) May 12 14:35:25.523539 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-723eade0-98c7-4ffc-a658-8b03aab6e0a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:25.524002 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-723eade0-98c7-4ffc-a658-8b03aab6e0a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:25.524791 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-723eade0-98c7-4ffc-a658-8b03aab6e0a8 admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:25.525213 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-723eade0-98c7-4ffc-a658-8b03aab6e0a8 admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:25.560921 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-723eade0-98c7-4ffc-a658-8b03aab6e0a8 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160637 May 12 14:35:25.561505 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Thu May 12 14:35:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:35:26.508612 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:26.510171 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 May 12 14:35:26.510790 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:26.715934 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-577dbecc-79e6-480e-937f-720be1c397de admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:26.717044 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:35:26.717044 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: warnings.warn(msg) May 12 14:35:26.718249 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-577dbecc-79e6-480e-937f-720be1c397de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.718712 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-577dbecc-79e6-480e-937f-720be1c397de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.719501 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-577dbecc-79e6-480e-937f-720be1c397de admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.719950 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-577dbecc-79e6-480e-937f-720be1c397de admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.739868 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-577dbecc-79e6-480e-937f-720be1c397de admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.093162 May 12 14:35:26.740425 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Thu May 12 14:35:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:35:38.110362 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:38.111376 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 12 14:35:38.112025 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 36/73] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:38.307284 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-9b12a169-8f6a-4790-a95f-638115780e52 admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:38.308513 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:35:38.308513 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: warnings.warn(msg) May 12 14:35:38.309725 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-9b12a169-8f6a-4790-a95f-638115780e52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.310158 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-9b12a169-8f6a-4790-a95f-638115780e52 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.310935 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-9b12a169-8f6a-4790-a95f-638115780e52 admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.311356 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-9b12a169-8f6a-4790-a95f-638115780e52 admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.337343 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-9b12a169-8f6a-4790-a95f-638115780e52 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086878 May 12 14:35:38.337905 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 38/74] 10.222.0.79 () {60 vars in 1193 bytes} [Thu May 12 14:35:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:39.255255 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: DEBUG nova.api.openstack.wsgi [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] Calling method '>' {{(pid=102952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:39.256633 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: INFO nova.api.openstack.requestlog [None req-7bad3663-48c0-40f1-82a3-47fc1d9cdac8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001938 May 12 14:35:39.257045 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: [pid: 102952|app: 0|req: 37/75] 10.222.0.79 () {56 vars in 1074 bytes} [Thu May 12 14:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:39.456996 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG nova.api.openstack.wsgi [None req-efe390e2-10c8-4355-81d1-5123bb07f6fe admin admin] Calling method '>' {{(pid=102953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:39.458168 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:35:39.458168 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: warnings.warn(msg) May 12 14:35:39.459335 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-efe390e2-10c8-4355-81d1-5123bb07f6fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.459799 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-efe390e2-10c8-4355-81d1-5123bb07f6fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.460569 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-efe390e2-10c8-4355-81d1-5123bb07f6fe admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.460987 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: DEBUG oslo_concurrency.lockutils [None req-efe390e2-10c8-4355-81d1-5123bb07f6fe admin admin] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.481823 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: INFO nova.api.openstack.requestlog [None req-efe390e2-10c8-4355-81d1-5123bb07f6fe admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084384 May 12 14:35:39.482337 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: [pid: 102953|app: 0|req: 39/76] 10.222.0.79 () {60 vars in 1193 bytes} [Thu May 12 14:35:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:38.685024 dv-cinder-840678-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 14:36:38.685976 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: Thu May 12 14:36:38 2022 - graceful shutdown triggered... May 12 14:36:38.686808 dv-cinder-840678-8-iscsi devstack@n-api.service[102952]: Gracefully killing worker 1 (pid: 102952)... May 12 14:36:38.688162 dv-cinder-840678-8-iscsi devstack@n-api.service[102953]: Gracefully killing worker 2 (pid: 102953)... May 12 14:36:39.686405 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: worker 1 buried after 1 seconds May 12 14:36:39.686405 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: worker 2 buried after 1 seconds May 12 14:36:39.686405 dv-cinder-840678-8-iscsi devstack@n-api.service[102951]: goodbye to uWSGI. May 12 14:36:39.689003 dv-cinder-840678-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 14:36:39.689932 dv-cinder-840678-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 14:36:39.694593 dv-cinder-840678-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 14:36:39.716607 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:36:39 2022] *** May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: nodename: dv-cinder-840678-8-iscsi May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: machine: x86_64 May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: clock source: unix May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: pcre jit disabled May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: detected number of CPU cores: 4 May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: current working directory: / May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: detected binary path: /usr/bin/uwsgi-core May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: your processes number limit is 47680 May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: your memory page size is 4096 bytes May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: detected max file descriptor number: 2048 May 12 14:36:39.744696 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: lock engine: pthread robust mutexes May 12 14:36:39.745861 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: thunder lock: enabled May 12 14:36:39.745861 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 14:36:39.745861 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:36:39.799538 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: Python main interpreter initialized at 0x55576a7889c0 May 12 14:36:39.799538 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: python threads support enabled May 12 14:36:39.799538 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: your server socket listen backlog is limited to 100 connections May 12 14:36:39.799538 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: your mercy for graceful operations on workers is 90 seconds May 12 14:36:39.800035 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:36:39.800035 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: *** Operational MODE: preforking *** May 12 14:36:39.800300 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: *** uWSGI is running in multiple interpreter mode *** May 12 14:36:39.800300 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: spawned uWSGI master process (pid: 123710) May 12 14:36:39.800474 dv-cinder-840678-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 14:36:39.802242 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: spawned uWSGI worker 1 (pid: 123725, cores: 1) May 12 14:36:39.803925 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: spawned uWSGI worker 2 (pid: 123726, cores: 1) May 12 14:36:39.804245 dv-cinder-840678-8-iscsi devstack@n-api.service[123710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:36:41.004817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:36:41.017058 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:36:41.798266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:36:41.798266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: from cryptography.utils import int_from_bytes May 12 14:36:41.798617 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:36:41.798617 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: from cryptography.utils import int_from_bytes May 12 14:36:41.809757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:36:41.809757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: from cryptography.utils import int_from_bytes May 12 14:36:41.810150 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:36:41.810150 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: from cryptography.utils import int_from_bytes May 12 14:36:44.232212 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:36:44.232825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:36:44.233224 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:36:44.233408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:36:44.233627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:36:44.234022 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.234332 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.234668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.234993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.235338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.235634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.236064 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.236450 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.236843 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.237152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.237475 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.237807 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-8-iscsi {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.238133 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.238445 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.238764 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.239104 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.239412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.239743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.240083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.240670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.245556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-8-iscsi {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.246863 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.247625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.247625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.247995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.248139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.249107 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.249107 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.249107 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.249549 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.249692 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.249923 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.250548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.250548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.250869 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.251024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.251350 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.251731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.251962 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.252195 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.252521 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.252843 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.253160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.253473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.253785 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.254094 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.254408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.254719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.255030 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.255337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.255659 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.256069 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.256395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.256708 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.257029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.257432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.257688 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.257999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.258344 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.258666 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.258979 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.259297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.259620 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.259955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.260273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.260582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.260902 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.261229 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.261539 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.261853 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.262090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.262396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.262719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.263027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.263341 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.263650 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.263990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.264305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.264614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.264922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.265232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.265540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.265848 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.266157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.266489 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.266770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.267088 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.267407 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.267737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.268049 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.268356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.268664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.269144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.269309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.269590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.269917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.270234 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.270542 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.270860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.271170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.271609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.271966 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.272236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.272545 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.272862 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.273174 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.273478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.273780 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.274086 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.274400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.274705 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.275009 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.275316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.275615 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.275963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.276288 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.276603 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.276909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.277219 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.277538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.277883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.278213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.278555 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.278871 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.279203 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.279533 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.279740 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:36:44.280270 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.280423 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:36:44.280565 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.280715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:36:44.280892 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.280892 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.281180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:36:44.281180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:36:44.281484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.281484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.281861 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.282034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.282304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.282459 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.282609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.282752 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.282913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.283198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.283414 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.283750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.283919 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.284062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.284210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.284351 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.284610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.284763 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.284949 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.285107 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.285265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.285414 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.285555 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.285739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.285896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-8-iscsi {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.286047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.286193 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.286340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.286480 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.286480 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.286770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.286922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.287078 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.287226 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.287373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.287526 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.287673 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.287866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.288021 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.288021 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.288327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.288327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.288710 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.288850 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.289022 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.289168 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.289317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.289468 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.289620 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.289773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.289914 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.290053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.290201 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.290342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.290481 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.290631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.290879 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.291042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.291184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.291335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.291486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.291486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.291864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-8-iscsi {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.292081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.292473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.292631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.292781 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.292930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.293083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.293372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.293611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.293796 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.294050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.294216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.294368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.294517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.294761 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.294908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.295063 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.295216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.295746 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.295904 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.296057 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.296207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.296393 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.296549 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.296708 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.296850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.296989 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.297160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.297312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.297474 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.297626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.297767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.297912 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.298060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.298206 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.298354 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.298501 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.298653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.298800 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.298958 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.299140 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.299287 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.299434 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.299574 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.299765 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.299920 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.300074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.300215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.300354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.300517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.300658 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.300806 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.300954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.301111 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.301252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.301392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.301539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.301694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.301867 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.302011 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.302246 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.302421 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.302771 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.302934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.303084 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.303504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.303816 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.303984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.304245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.304403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.304545 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.304545 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.304926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.305075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.305419 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.305575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.305727 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.305878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.305878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.306155 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.306305 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.306454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.306454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.306728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.306728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.307009 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.307173 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.307314 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.307454 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.307602 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.307769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.307922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.308073 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.308214 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.308371 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.308521 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.308667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.308817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.308966 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.309133 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.309274 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.309413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.309552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.309699 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.309699 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.309979 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.310138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.310286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.310426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.310572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.310572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.310858 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.311008 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.311148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.311306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.311446 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.311599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.311757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.311923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.312073 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.312240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.312485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.312796 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.312945 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.313086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.313276 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.313532 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.313760 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.313992 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.314147 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.314398 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.314545 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.314696 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.314837 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.315097 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.315253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.315403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.315562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.315770 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.315931 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.316081 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.316228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.316369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.316515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.316662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.316875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.317019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.317159 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.317298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.317437 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.317595 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.317746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.317936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.318090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.318715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.318877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.319019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.319208 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.319409 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.319562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.319735 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.319894 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.320050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.320209 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.320357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.320513 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.320663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.320663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.320937 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.321078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.321217 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.321399 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.321557 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.321706 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.321846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.321993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.322151 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.322301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.322467 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.322692 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.322997 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.323150 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.323291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.323444 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.323682 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.323980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.324197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.324342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.324594 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.324769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.324920 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.325088 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.325323 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.325476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.325634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.325777 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.325919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.326066 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.326215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.326364 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.326526 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.326680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.326831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.326973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.327113 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.327261 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.327410 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.327558 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.327725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.327883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:36:44.328027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.328295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.328519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.328707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.328895 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.329071 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.329247 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.329438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.329622 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.329806 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.329992 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.330179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.330367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.330552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.330736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.330913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.331097 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.331283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.331457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.331646 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.331914 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.332092 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.332279 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.332464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.332736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.333106 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.333370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.333567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.334080 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.334418 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.334605 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.334605 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.334994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.335138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.335278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.335541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.335785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.335934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.336075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.336227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.336369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.336518 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.336680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.336830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.336980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.337128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.337270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.337455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.337616 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.337758 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.337899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.338039 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.338188 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.338344 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.338493 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.338660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.338810 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.338961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.339102 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.339251 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.339399 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.339542 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.339682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.339870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.340021 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.340172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.340321 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.340468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.340619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.340759 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.340907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.341062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.341211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.341362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.341510 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.341658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.341808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.341957 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.342105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.342253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.342404 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.342544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.342694 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.342945 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.343251 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.343412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.343554 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.343715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.343980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.344221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.344613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.344770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.345034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.345194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.345351 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.345508 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.345768 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.345917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.346058 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.346212 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.346352 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.346352 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.346617 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.346758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.346906 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.347067 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.347219 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.347358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.347497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.347643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.347816 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.348002 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.348148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.348288 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.348427 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.348574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.348574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.348922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.349065 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.349216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.349363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.349544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.349700 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.349848 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.349989 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.350331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.350490 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.350632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.350772 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.350918 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.351069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.351232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.351383 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.351532 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.351721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.351969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.352138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.352295 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.352444 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.352586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.352732 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.352872 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.353096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.353370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.353370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.353693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.353693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.353984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.353984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.354426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.354716 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.354864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.355031 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.355260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.355410 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.355567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.355736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.355990 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.356137 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.356279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.356433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.356575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.356715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.356863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.357010 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.357151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.357300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.357443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.357590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.357739 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.357889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.358039 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.358039 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.358325 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.358467 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.358663 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.358817 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.358966 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.359116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.359257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.359403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.359551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.359719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.359884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.360035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.360184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.360330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.360477 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.360659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.360821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.360978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.361126 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.361282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.361429 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.361577 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.361743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.361890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.362043 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.362190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.362343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.362490 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.362645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.362792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.362939 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.363102 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.363316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.363561 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.363773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.363773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.364103 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.364344 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.364572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.364878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.365033 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.365528 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.365702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.365864 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.366029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.366275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.366467 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.366624 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.366792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.366940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.367097 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.367255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.367402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.367548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.367719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.367886 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.368042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.368191 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.368345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.368493 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.368639 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.368795 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.368956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.369104 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.369250 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.369396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.369583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.369735 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.369893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370196 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370350 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370505 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370663 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370823 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370979 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.370979 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.371273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.371420 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.371576 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.371776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.371931 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.372089 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.372253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.372408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.372569 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.372726 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.372873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.373027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.373175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.373339 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.373589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.373819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.373981 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.374137 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.374284 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.374526 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.374768 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.375068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.375237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.375386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.375550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.375812 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.375984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376761 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.376917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.377621 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.377621 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.377921 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.378083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.378238 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.378393 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.378548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.378704 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.378861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.379016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.379163 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.379163 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.379471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.379627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.379838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.379995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.380142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.380289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.380446 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.380601 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.380771 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.380932 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.381079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.381233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.381404 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.381561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.381733 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.381891 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.382046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.382201 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.382357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.382507 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.382653 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.382799 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.382952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.383179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.383343 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.383502 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.383762 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.383997 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.384157 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.384315 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.384471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.384707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.385092 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.385257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.385405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.385562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.385755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.386009 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.386179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.386337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.386497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.386676 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.386923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.387084 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.387233 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.387387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.387534 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.387708 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.387882 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.388039 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.388186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.388352 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.388514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.388669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.388820 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.388966 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.389113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.389274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.389431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.389579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.389734 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.389883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.390036 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.390201 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.390357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.390505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.390651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.390804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.390952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.391271 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.391427 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.391583 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.391805 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.391962 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.392110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.392272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.392438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.392586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.392778 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.392929 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.393077 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.393233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.393387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.393543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.393691 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.393922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.394158 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.394321 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.394477 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.394635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.394865 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.394865 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.395377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.395541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.395712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.395866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.396025 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.396231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.396579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.396579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.396885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.397149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.397323 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.397472 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.397629 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.397777 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.397777 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.398063 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.398210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.398356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.398570 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.398726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.398874 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.399019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.399185 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.399347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.399495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.399641 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.399851 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.400013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.400013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.400296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.400296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.400585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.400585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.400877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.401033 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.401197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.401347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.401501 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.401656 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.401803 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.401951 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.402105 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.402266 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.402427 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.402583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.402730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.402878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.403033 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.403197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.403346 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.403502 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.403661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.403916 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.404146 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.404373 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.404527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.404693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.404860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.405091 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.405426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.405589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.405757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.405918 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.406066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.406228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.406385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.406533 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.406800 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.406962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.406962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.407343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.407504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.407653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.407849 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.408009 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.408164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.408319 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.408472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.408628 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.408786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.408942 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.409090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.409245 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.409394 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.409556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.409556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.409847 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.409996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.410151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.410300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.410461 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.410610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.410764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.410912 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.411066 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.411213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.411368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.411515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.411661 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.411891 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.412077 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.412226 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.412386 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.412535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.412684 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.412852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.413008 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.413170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.413327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.413482 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.413628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.413796 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.413944 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.414122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.414355 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.414576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.414738 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.414886 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.415034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.415277 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.415635 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.415822 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.415972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.416120 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.416278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.416435 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.416581 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.416730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.416980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.417135 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.417296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.417553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.417707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.417905 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.418066 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.418214 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.418375 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.418543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.419298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.419298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.419612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.419795 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.419949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.420104 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.420590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.420755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.421146 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.421310 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.421471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.421627 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.421858 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.422018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.422226 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.422388 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.422538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.422693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.422850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.423005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.423153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.423316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.423473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.423633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.423821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.423977 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.424124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.424278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.424548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.424833 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.424997 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.425148 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.425315 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.425781 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.425940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.426102 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.426272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.426429 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.426578 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.426725 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.426872 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.427143 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.427297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.427444 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.427884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.428050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.428244 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.428409 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.428572 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.428721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.428868 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.429023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.429181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.429329 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.429476 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.429631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.429789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.429944 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.430111 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.430269 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.430426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.430619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.430777 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.430932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.431082 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.431259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.431419 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.431566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.431749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.431914 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.432062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.432219 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.432374 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.432522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.432687 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.432837 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.432984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.433177 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.433338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.433572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.433746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.433899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.434057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.434213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.434213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.434520 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.434773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.435021 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.436178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.436363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.436514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.436734 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.436899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.437050 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.437306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.437471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.437631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.437795 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.437973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.438145 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.438303 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.438452 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.438607 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.438770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.438919 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.439066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.439216 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.439371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.439525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.439700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.439869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.440020 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.440180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.440337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.440496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.440644 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.440792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.440946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.441094 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.441242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.441399 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.441548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.441702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.441702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.442011 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.442173 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.442330 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.442478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.442633 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.442790 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.442939 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.443095 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.443267 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.443423 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.443571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.443801 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.443972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.444135 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.444291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.444439 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.444600 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.444600 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.444995 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.445225 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.445388 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.445545 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.445714 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.446145 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.446385 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.446558 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.446707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.446855 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.447002 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.447149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.447326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.447571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.447752 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.447908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.448064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.448221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.448383 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.448544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.448699 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.448855 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.449012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.449173 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.449330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.449330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.449625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.449780 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.449969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.450129 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.450278 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.450440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.450606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.450756 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.450903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.451058 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.451207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.451414 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.451566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.451736 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.451889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.452054 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.452213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.452368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.452516 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.452516 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.452832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.452989 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.453137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.453284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.453431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.453595 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.453752 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.453916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.454064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.454219 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.454366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.454366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.454679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.454830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.455002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.455231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.455455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.455614 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.455830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.456263 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.456429 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.456580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.456771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.456975 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.457148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.457298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.457494 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.457773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.457935 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.458095 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.458244 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.458393 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.458540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.458687 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.458855 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.459073 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.459225 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.459391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.459547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.459715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.459870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.459870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.460165 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.460348 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.460509 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.460671 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.460832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.460980 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.461128 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.461293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.461448 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.461606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.461773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.461921 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.462075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.462231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.462231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.462549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.462713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.462863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.463018 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.463167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.463342 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.463619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.463828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.463980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.464136 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.464285 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.464665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.464830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.464981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.465137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.465374 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.465586 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.465753 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.465925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.466375 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.466541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.466693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.466848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.467004 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.467167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.467323 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.467473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.467630 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.467902 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.468058 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.468224 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.468394 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.468612 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.468771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.468931 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.469094 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.469242 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.469390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.469537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.469685 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.469840 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.470005 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.470161 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.470313 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.470476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.470627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.470774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.470935 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.471084 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.471231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.471378 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.471534 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.471707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.471874 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.472024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.472179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.472338 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.472484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.472611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.472798 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.472960 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.473139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.473301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.473450 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.473651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.473884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.474044 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.474191 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.474348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.474549 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.474751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.474903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.475051 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.475223 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.475403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.475636 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.475872 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.476024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.476332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.476623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.476779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.476955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.477105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.477254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.477401 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.477553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.477718 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.477988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.478235 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.478395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.478584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.478742 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.478891 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.479054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.479223 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.479223 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.479514 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.479669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.479856 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.480018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.480176 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.480332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.480480 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.480635 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.480797 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.480946 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.481093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.481252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.481407 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.481557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.481723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.481723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.482058 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.482210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.482367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.482531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.482682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.482838 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.482985 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.483184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.483345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.483345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.483645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.483645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.483645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.484240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.484392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.484550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.484706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.484855 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.485004 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.485152 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.485350 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.485512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.485753 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.485915 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.486064 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.486219 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.486515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.486515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.486952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.487101 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.487259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.487448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.487448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.487853 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.487984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488104 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488209 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488417 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488604 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488803 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.488969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489049 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489194 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489805 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489906 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.489995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.490184 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.490309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.490462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.490644 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.490807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.490955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491342 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491809 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.491987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492074 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492160 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492160 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492330 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492416 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492509 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492696 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492898 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.492985 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493070 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493352 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493440 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493535 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493800 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493901 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.493996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494524 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494779 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494779 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.494947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495780 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.495987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496352 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496445 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496697 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496857 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.496928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497119 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497307 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497685 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.497772 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498087 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498181 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498373 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498459 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498459 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498690 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.498972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499058 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499150 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499238 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499421 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.499925 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500202 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500202 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500552 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500640 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500813 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500899 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.500899 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.501727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.502846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.503466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.504804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.505197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.505197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.505510 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.505876 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.506174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.506494 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.506837 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.507156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.507757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.507757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.508217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.508393 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.508725 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.509040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.509347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.509775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.510072 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.510391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.510713 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.511024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.511340 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.511660 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.511994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.512315 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.512627 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.512949 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.513057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_db.sqlalchemy.engines [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:44.513280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.513608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.513937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.514260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.514565 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.514854 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.515164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.515482 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.515816 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.516222 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.516418 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.516761 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.517036 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.517339 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.517641 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.517941 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.518249 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.518550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.518859 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.519159 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.519459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.519896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.520093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.520402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.520705 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.521009 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.521311 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.521719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.521986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.522320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.522654 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.522970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.523295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.523607 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.523954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.524264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.524585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.524906 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.525225 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.525534 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.525868 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.526180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.526491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.526807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.527122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.527432 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.527895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.528232 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.528560 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.528869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.529194 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.529511 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.529835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.530152 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.530508 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.530838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.531192 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.531464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.531804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.532121 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.532433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.532751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.533068 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.533405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.533723 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.534098 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.534371 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.534721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.535034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.535377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.535723 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.536043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.536358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.536665 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:36:44.536917 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:36:44.560765 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_db.sqlalchemy.engines [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:44.580441 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.context [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b6a5814-8930-4726-ad38-75a9ded38aa1(cell1) {{(pid=123725) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:36:44.585382 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.587008 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.587915 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.589817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.603627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_db.sqlalchemy.engines [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:44.605468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_db.sqlalchemy.engines [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:44.628920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.context [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b6a5814-8930-4726-ad38-75a9ded38aa1(cell1) {{(pid=123726) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:36:44.633481 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.635055 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.635895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.637829 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.649607 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_db.sqlalchemy.engines [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:44.651377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_db.sqlalchemy.engines [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:44.769730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_db.sqlalchemy.engines [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:44.810459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_db.sqlalchemy.engines [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:36:45.087985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: WARNING keystonemiddleware.auth_token [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:36:45.095609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: WARNING keystonemiddleware.auth_token [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:36:45.155828 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: WARNING keystonemiddleware.auth_token [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:36:45.163871 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: WARNING keystonemiddleware.auth_token [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:36:45.439506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: WARNING keystonemiddleware.auth_token [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:36:45.446029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: WARNING keystonemiddleware.auth_token [None req-6645a9a3-6f49-4533-b7a8-399f5da519cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:36:45.451186 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55576a7889c0 pid: 123725 (default app) May 12 14:36:45.532243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: WARNING keystonemiddleware.auth_token [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:36:45.538722 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: WARNING keystonemiddleware.auth_token [None req-4132cf74-7be6-44b9-8f96-eb0a98e9182a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:36:45.543926 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55576a7889c0 pid: 123726 (default app) May 12 14:37:29.026854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-60eb66ec-615c-4cc2-9395-82a1ab4a16b8 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Action: 'create', calling method: .version_select at 0x7f4652b2e280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1059947684", "metadata": {"Type": "work"}}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:30.735047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-60eb66ec-615c-4cc2-9395-82a1ab4a16b8 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.055282 May 12 14:37:30.736048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1155 bytes} [Thu May 12 14:37:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3058 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 14:37:30.750014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-208d65b8-10d0-4f18-91c6-9cb6bdcd9352 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Calling method '.version_select at 0x7f4652987280>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:30.866388 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1306739036", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "networks": [{"uuid": "586bf05d-2967-4ec3-b588-a29598f5b674"}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:30.999066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-208d65b8-10d0-4f18-91c6-9cb6bdcd9352 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef" status: 200 len: 353 microversion: 2.1 time: 0.253977 May 12 14:37:31.001672 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 2/2] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:37:30 2022] GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:37:31.351970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] validate_networks() for [('586bf05d-2967-4ec3-b588-a29598f5b674', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:37:32.016749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b296d7a8-2268-4b5c-8a16-efef0b194db0 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Calling method '.version_select at 0x7f4652987430>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:32.177128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b296d7a8-2268-4b5c-8a16-efef0b194db0 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef" status: 200 len: 353 microversion: 2.1 time: 0.165736 May 12 14:37:32.177831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 3/3] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:37:32 2022] GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:37:33.137182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:37:33.138151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:37:33.145582 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:37:33.146344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:37:33.146779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:37:33.184490 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:33.187467 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:33.190437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:33.193837 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:33.227944 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-84a94fcb-bcef-454c-be05-49bf428d7bea tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Calling method '.version_select at 0x7f46529879d0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:33.320092 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Getting quotas for project c865b8a441ac423e9032a0c70301ec6e. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:37:33.339124 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Getting quotas for user 6f801c74ab294ea98c631aa74aed8f07 and project c865b8a441ac423e9032a0c70301ec6e. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:37:33.400165 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:37:33.413313 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:37:33.452679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-84a94fcb-bcef-454c-be05-49bf428d7bea tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef" status: 200 len: 354 microversion: 2.1 time: 0.242954 May 12 14:37:33.453139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 4/4] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:37:33 2022] GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef => generated 354 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:37:33.472559 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-69730f4a-9503-4d02-8dd7-14fc7df9d4b0 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Calling method '.version_select at 0x7f46529900d0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:33.663075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-69730f4a-9503-4d02-8dd7-14fc7df9d4b0 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef" status: 200 len: 354 microversion: 2.1 time: 0.201210 May 12 14:37:33.670674 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 5/5] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:37:33 2022] GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:37:33.683255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-12134b12-ef22-4b47-b544-1c2b7a57b481 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Calling method '.version_select at 0x7f4652987d30>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:33.741259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7898efc0-8e4a-4b14-be0d-7f0fc2e19cfa tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.536061 May 12 14:37:33.741921 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 1/6] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:37:33.796321 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ebc76992-a701-4381-9e12-5ecb9e0aec96 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:33.797130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ebc76992-a701-4381-9e12-5ecb9e0aec96 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:33.954484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-12134b12-ef22-4b47-b544-1c2b7a57b481 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef" status: 202 len: 0 microversion: 2.1 time: 0.282091 May 12 14:37:33.957377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 6/7] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:37:33 2022] DELETE /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:37:33.967980 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b7fb4050-8aa8-4bd1-938f-5a3f7a0bc079 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Calling method '.version_select at 0x7f4652987670>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:34.140059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b7fb4050-8aa8-4bd1-938f-5a3f7a0bc079 tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef" status: 200 len: 353 microversion: 2.1 time: 0.178872 May 12 14:37:34.140658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 7/8] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:37:33 2022] GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:37:34.259263 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ebc76992-a701-4381-9e12-5ecb9e0aec96 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:34.317623 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ebc76992-a701-4381-9e12-5ecb9e0aec96 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1215 microversion: 2.1 time: 0.564333 May 12 14:37:34.320911 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 2/9] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:33 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1215 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:35.160627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7cc689ee-8eda-413c-9d22-c1c5b3cda9ad tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Calling method '.version_select at 0x7f46529904c0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:35.218780 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-7cc689ee-8eda-413c-9d22-c1c5b3cda9ad tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] HTTP exception thrown: Volume 654faaac-ac3b-47c0-83c5-cdd703763fef could not be found. May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7cc689ee-8eda-413c-9d22-c1c5b3cda9ad tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Request method failure captured: May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef HTTP/1.1 May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRun3byMsjqdv5fRCk81qTob6rHEtAwkKcVfzD1sqIzJAcIaIwzL0fCYX-3KKxpD8PnZETk2JZXE2-GvnLnTQAwkCfZJhxK16LIJosDLDMDVROZsb2romuxHsjaKGaj6wzgYlS4Hypr2VAgzLJ-LaLHS6FfwpScViUK0orlULkKwm-A May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 16f5ef2fef0e45ffa7bb70f56141e6b3 May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesGetTestJSON-725448090 May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:37:35.225825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16f5ef2fef0e45ffa7bb70f56141e6b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16f5ef2fef0e45ffa7bb70f56141e6b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_16f5ef2fef0e45ffa7bb70f56141e6b3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/16f5ef2fef0e45ffa7bb70f56141e6b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesGetTestJSON-725448090 May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 16f5ef2fef0e45ffa7bb70f56141e6b3 May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesGetTestJSON-725448090 May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesGetTestJSON-725448090-project May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 7a2da6951ae64b9d93715154b3c605ba May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesGetTestJSON-725448090-project May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Volume 654faaac-ac3b-47c0-83c5-cdd703763fef could not be found. May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '654faaac-ac3b-47c0-83c5-cdd703763fef'} May 12 14:37:35.226973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 654faaac-ac3b-47c0-83c5-cdd703763fef could not be found. (HTTP 404) (Request-ID: req-b36620df-b53c-4c50-b96f-a31656d958d4) May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:35.227576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:37:35.228492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 654faaac-ac3b-47c0-83c5-cdd703763fef could not be found. May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:37:35.230001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 654faaac-ac3b-47c0-83c5-cdd703763fef could not be found. May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 654faaac-ac3b-47c0-83c5-cdd703763fef could not be found. May 12 14:37:35.231669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:35.241440 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7cc689ee-8eda-413c-9d22-c1c5b3cda9ad tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] Returning 404 to user: Volume 654faaac-ac3b-47c0-83c5-cdd703763fef could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:35.242792 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7cc689ee-8eda-413c-9d22-c1c5b3cda9ad tempest-VolumesGetTestJSON-725448090 tempest-VolumesGetTestJSON-725448090-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef" status: 404 len: 109 microversion: 2.1 time: 0.090191 May 12 14:37:35.244840 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 8/10] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:37:35 2022] GET /compute/v2.1/os-volumes/654faaac-ac3b-47c0-83c5-cdd703763fef => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:37:35.337634 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7ff9bc7d-1fbe-491d-aff8-cb6f45890555 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:35.338250 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7ff9bc7d-1fbe-491d-aff8-cb6f45890555 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:35.758680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7ff9bc7d-1fbe-491d-aff8-cb6f45890555 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:35.771626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7ff9bc7d-1fbe-491d-aff8-cb6f45890555 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1215 microversion: 2.1 time: 0.435070 May 12 14:37:35.773690 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 3/11] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:35 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1215 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:36.789254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:36.790013 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:36.825037 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:36.825491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:36.826471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:36.827039 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:37.371553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:37.406424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8e0d6a84-2769-4d6b-92b7-2b3a6fabf689 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1219 microversion: 2.1 time: 0.620432 May 12 14:37:37.412371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 9/12] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:36 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1219 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:38.430666 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:38.433294 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:38.445588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:38.446339 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:38.453021 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:38.455975 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:38.834808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:38.861924 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7e4c5f26-95f7-4ae1-8d60-8939d3d4d65f tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1219 microversion: 2.1 time: 0.435063 May 12 14:37:38.863185 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 4/13] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:38 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1219 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:39.882094 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:39.883328 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:39.905840 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:39.911709 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:39.927999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:39.933308 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:40.248955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:40.262103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-df015ea8-f780-4b75-baf3-8a0f6a931de8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1219 microversion: 2.1 time: 0.386006 May 12 14:37:40.271143 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 10/14] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:39 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1219 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:40.660170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-18bec616-790a-41cb-8ff1-476364d66457 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Action: 'create', calling method: .version_select at 0x7f465184c9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1438388378", "metadata": {"Type": "work"}}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-18bec616-790a-41cb-8ff1-476364d66457 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Request method failure captured: May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 122 May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRuzlIB610ZHwU4gT3Yjk6EzZoZFz7kZC7PPwZTMoNfYTtqcDV33MLTcYYdegHhDMqLWV-n81VM-cqGAVYcal2qarcnj_-mCTRgQrj72bYxAsVu8TUy7GY6KuqkoS6G1WKssXZr94uabYck8BS9veOX3VI-qzWcte7ZuSVlCnmIqmG8 May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:37:40.676356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_953502eb40e24490887dd6cc7009f8c7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: c89fe6b04b6e45acb29d9cdd0af1f291 May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1438388378", "metadata": {"Type": "work"}}} May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: May 12 14:37:40.677551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1438388378', 'metadata': {'Type': 'work'}}}} May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise error May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi '#$%' May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:40.678174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 14:37:40.679170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 14:37:40.680069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 14:37:40.680069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.683542 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-18bec616-790a-41cb-8ff1-476364d66457 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:40.685530 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-18bec616-790a-41cb-8ff1-476364d66457 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.510736 May 12 14:37:40.686118 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 5/15] 10.222.0.79 () {60 vars in 1155 bytes} [Thu May 12 14:37:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 512 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 14:37:40.695848 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f8a50b0d-68e1-476a-8341-406e6449724a tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Action: 'create', calling method: .version_select at 0x7f46528a0b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-452548085", "metadata": {"Type": "work"}}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f8a50b0d-68e1-476a-8341-406e6449724a tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Request method failure captured: May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 119 May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRuzlIB610ZHwU4gT3Yjk6EzZoZFz7kZC7PPwZTMoNfYTtqcDV33MLTcYYdegHhDMqLWV-n81VM-cqGAVYcal2qarcnj_-mCTRgQrj72bYxAsVu8TUy7GY6KuqkoS6G1WKssXZr94uabYck8BS9veOX3VI-qzWcte7ZuSVlCnmIqmG8 May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:37:40.699318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_953502eb40e24490887dd6cc7009f8c7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: c89fe6b04b6e45acb29d9cdd0af1f291 May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-452548085", "metadata": {"Type": "work"}}} May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: May 12 14:37:40.700425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-452548085', 'metadata': {'Type': 'work'}}}} May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise error May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi '0' May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:40.701062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 14:37:40.702090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 14:37:40.702988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 14:37:40.702988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.704946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f8a50b0d-68e1-476a-8341-406e6449724a tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:40.708134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f8a50b0d-68e1-476a-8341-406e6449724a tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016676 May 12 14:37:40.712268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 11/16] 10.222.0.79 () {60 vars in 1155 bytes} [Thu May 12 14:37:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:37:40.725024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-50961ef1-5a6e-445f-b0f3-290d65c15ca5 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Action: 'create', calling method: .version_select at 0x7f46533598b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1381804701", "metadata": {"Type": "work"}}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-50961ef1-5a6e-445f-b0f3-290d65c15ca5 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Request method failure captured: May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 119 May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRuzlIB610ZHwU4gT3Yjk6EzZoZFz7kZC7PPwZTMoNfYTtqcDV33MLTcYYdegHhDMqLWV-n81VM-cqGAVYcal2qarcnj_-mCTRgQrj72bYxAsVu8TUy7GY6KuqkoS6G1WKssXZr94uabYck8BS9veOX3VI-qzWcte7ZuSVlCnmIqmG8 May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:37:40.728522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_953502eb40e24490887dd6cc7009f8c7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: c89fe6b04b6e45acb29d9cdd0af1f291 May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1381804701", "metadata": {"Type": "work"}}} May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: May 12 14:37:40.729626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1381804701', 'metadata': {'Type': 'work'}}}} May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise error May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi '' May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:40.730254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 14:37:40.731299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 14:37:40.733525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 14:37:40.733525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:40.738131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-50961ef1-5a6e-445f-b0f3-290d65c15ca5 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:40.741390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-50961ef1-5a6e-445f-b0f3-290d65c15ca5 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023304 May 12 14:37:40.745106 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 6/17] 10.222.0.79 () {60 vars in 1155 bytes} [Thu May 12 14:37:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:37:40.754167 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-35ed5866-0507-4434-96d0-d7f518b0cffa tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Calling method '.version_select at 0x7f465286b040>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:40.829969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-35ed5866-0507-4434-96d0-d7f518b0cffa tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] HTTP exception thrown: Volume tempest-invalid-561630718 could not be found. May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-35ed5866-0507-4434-96d0-d7f518b0cffa tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Request method failure captured: May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-561630718 HTTP/1.1 May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRuzlIB610ZHwU4gT3Yjk6EzZoZFz7kZC7PPwZTMoNfYTtqcDV33MLTcYYdegHhDMqLWV-n81VM-cqGAVYcal2qarcnj_-mCTRgQrj72bYxAsVu8TUy7GY6KuqkoS6G1WKssXZr94uabYck8BS9veOX3VI-qzWcte7ZuSVlCnmIqmG8 May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:37:40.832153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_953502eb40e24490887dd6cc7009f8c7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: c89fe6b04b6e45acb29d9cdd0af1f291 May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Volume tempest-invalid-561630718 could not be found. May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'tempest-invalid-561630718'} May 12 14:37:40.833698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-561630718 could not be found. (HTTP 404) (Request-ID: req-77fecea7-38d9-424c-8347-1f9f7119fd30) May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.834391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:37:40.835387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-561630718 could not be found. May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:37:40.836296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-561630718 could not be found. May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-561630718 could not be found. May 12 14:37:40.837207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:40.839639 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-35ed5866-0507-4434-96d0-d7f518b0cffa tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Returning 404 to user: Volume tempest-invalid-561630718 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:40.840813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-35ed5866-0507-4434-96d0-d7f518b0cffa tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-561630718" status: 404 len: 98 microversion: 2.1 time: 0.090621 May 12 14:37:40.841718 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 12/18] 10.222.0.79 () {58 vars in 1214 bytes} [Thu May 12 14:37:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-561630718 => generated 98 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 14:37:40.854593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5b351e6e-57fb-4e2b-b232-898fa9f943f3 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006969 May 12 14:37:40.855883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 7/19] 10.222.0.79 () {58 vars in 1139 bytes} [Thu May 12 14:37:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 14:37:40.866494 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a011ba47-6652-493a-97e2-ea0c991be985 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005601 May 12 14:37:40.870678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 13/20] 10.222.0.79 () {58 vars in 1136 bytes} [Thu May 12 14:37:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 12 14:37:40.880933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e93228bf-3a59-45d3-876a-052f83800a54 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Calling method '.version_select at 0x7f465185c0d0>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:41.003541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-e93228bf-3a59-45d3-876a-052f83800a54 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] HTTP exception thrown: Volume 602bc449-071d-4a47-9bda-30a468b8f9f2 could not be found. May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e93228bf-3a59-45d3-876a-052f83800a54 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Request method failure captured: May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/os-volumes/602bc449-071d-4a47-9bda-30a468b8f9f2 HTTP/1.1 May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRuzlIB610ZHwU4gT3Yjk6EzZoZFz7kZC7PPwZTMoNfYTtqcDV33MLTcYYdegHhDMqLWV-n81VM-cqGAVYcal2qarcnj_-mCTRgQrj72bYxAsVu8TUy7GY6KuqkoS6G1WKssXZr94uabYck8BS9veOX3VI-qzWcte7ZuSVlCnmIqmG8 May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:37:41.008333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_953502eb40e24490887dd6cc7009f8c7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesNegativeTest-1258501330 May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: c89fe6b04b6e45acb29d9cdd0af1f291 May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Volume 602bc449-071d-4a47-9bda-30a468b8f9f2 could not be found. May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '602bc449-071d-4a47-9bda-30a468b8f9f2'} May 12 14:37:41.009590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 602bc449-071d-4a47-9bda-30a468b8f9f2 could not be found. (HTTP 404) (Request-ID: req-de8181ed-395a-40b5-bafb-d38bf59f137b) May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:41.010308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:37:41.011314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 602bc449-071d-4a47-9bda-30a468b8f9f2 could not be found. May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 14:37:41.014079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 602bc449-071d-4a47-9bda-30a468b8f9f2 could not be found. May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 602bc449-071d-4a47-9bda-30a468b8f9f2 could not be found. May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e93228bf-3a59-45d3-876a-052f83800a54 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Returning 404 to user: Volume 602bc449-071d-4a47-9bda-30a468b8f9f2 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e93228bf-3a59-45d3-876a-052f83800a54 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/602bc449-071d-4a47-9bda-30a468b8f9f2" status: 404 len: 109 microversion: 2.1 time: 0.133836 May 12 14:37:41.016593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 8/21] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:37:40 2022] DELETE /compute/v2.1/os-volumes/602bc449-071d-4a47-9bda-30a468b8f9f2 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:37:41.021813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-48961eb2-c8ad-4691-a58c-c95fbf8f05a8 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Calling method '.version_select at 0x7f46528b5f70>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:41.085725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-48961eb2-c8ad-4691-a58c-c95fbf8f05a8 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] HTTP exception thrown: Volume 1c788b78-140b-4f1f-b7e5-bfc023e25cb4 could not be found. May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-48961eb2-c8ad-4691-a58c-c95fbf8f05a8 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Request method failure captured: May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/os-volumes/1c788b78-140b-4f1f-b7e5-bfc023e25cb4 HTTP/1.1 May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRuzlIB610ZHwU4gT3Yjk6EzZoZFz7kZC7PPwZTMoNfYTtqcDV33MLTcYYdegHhDMqLWV-n81VM-cqGAVYcal2qarcnj_-mCTRgQrj72bYxAsVu8TUy7GY6KuqkoS6G1WKssXZr94uabYck8BS9veOX3VI-qzWcte7ZuSVlCnmIqmG8 May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:37:41.087728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_953502eb40e24490887dd6cc7009f8c7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/953502eb40e24490887dd6cc7009f8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesNegativeTest-1258501330 May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 953502eb40e24490887dd6cc7009f8c7 May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesNegativeTest-1258501330 May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: c89fe6b04b6e45acb29d9cdd0af1f291 May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesNegativeTest-1258501330-project May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Volume 1c788b78-140b-4f1f-b7e5-bfc023e25cb4 could not be found. May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '1c788b78-140b-4f1f-b7e5-bfc023e25cb4'} May 12 14:37:41.088741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1c788b78-140b-4f1f-b7e5-bfc023e25cb4 could not be found. (HTTP 404) (Request-ID: req-979e883f-3b7e-4867-a791-aad6af247173) May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:41.089457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:37:41.099551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1c788b78-140b-4f1f-b7e5-bfc023e25cb4 could not be found. May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:37:41.100901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1c788b78-140b-4f1f-b7e5-bfc023e25cb4 could not be found. May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1c788b78-140b-4f1f-b7e5-bfc023e25cb4 could not be found. May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-48961eb2-c8ad-4691-a58c-c95fbf8f05a8 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] Returning 404 to user: Volume 1c788b78-140b-4f1f-b7e5-bfc023e25cb4 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-48961eb2-c8ad-4691-a58c-c95fbf8f05a8 tempest-VolumesNegativeTest-1258501330 tempest-VolumesNegativeTest-1258501330-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/1c788b78-140b-4f1f-b7e5-bfc023e25cb4" status: 404 len: 109 microversion: 2.1 time: 0.071438 May 12 14:37:41.102770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 14/22] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:37:41 2022] GET /compute/v2.1/os-volumes/1c788b78-140b-4f1f-b7e5-bfc023e25cb4 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:37:41.278555 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:41.279190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:41.313530 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:41.314006 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:41.314766 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:41.315205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:41.577417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:41.585900 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-28b7433c-284f-4fd5-8a0a-cc2f3af015bf tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1267 microversion: 2.1 time: 0.311177 May 12 14:37:41.595500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 9/23] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:41 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1267 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:41.805357 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e85304db-dab9-4d5f-8150-26c90a9f54c6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: .version_select at 0x7f465283fd30>, body: {"keypair": {"name": "tempest-keypair-36731124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDChFZfNm/ouu9FkbFQVWILW2H2FexsD5Y3Ul2PmeJTTFlItpzbRvdHjt8RBxCbuxmzVLJ1EaevwIz0YjVhs4/ONoGnkOXkykEjveYHFCW2XuTEA8hjLvokYh8vEPOMR5A=="}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:42.032132 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-e85304db-dab9-4d5f-8150-26c90a9f54c6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:37:42.063736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-e85304db-dab9-4d5f-8150-26c90a9f54c6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:37:42.332304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e85304db-dab9-4d5f-8150-26c90a9f54c6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.024890 May 12 14:37:42.342361 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 15/24] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:37:41 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:37:42.605207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:42.605815 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:42.624284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:42.624977 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:42.631875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:42.636213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:42.646146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-194813874", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:42.815135 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] validate_networks() for [('50fb2d7f-8dca-4e62-9436-b1a9279da276', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:37:43.361136 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:43.381860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-22bc168d-f8e6-42be-93f3-298cf5d3a8e0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1273 microversion: 2.1 time: 0.781058 May 12 14:37:43.383026 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 16/25] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:42 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1273 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:44.400588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:44.401363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:44.414580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:44.429789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:44.434071 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:44.434872 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:47.317725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:47.350471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9dda74f8-0c8b-46ac-a907-2c7bfe92f3fc tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 2.949509 May 12 14:37:47.353536 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 17/26] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:44 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 2958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:37:48.211737 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:37:48.212439 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:37:48.212982 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:37:48.213556 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:37:48.213978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:37:48.243220 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:48.243667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:48.251565 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:48.252186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:48.359550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:37:48.370767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:48.372134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:48.382837 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for user 99075fda1c7d4e7698e2062407bc2433 and project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:37:48.395571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:48.399882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:48.409630 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:48.410099 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:48.430361 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:37:48.441779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:37:48.656648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-76e7214a-39c7-4044-8400-2610e1209ae8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.567676 May 12 14:37:48.669244 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 10/27] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:37:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 6581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:37:48.709060 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6b95f6d6-b3f9-429a-a59d-b67e4ff65526 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:48.710086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6b95f6d6-b3f9-429a-a59d-b67e4ff65526 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:49.360034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:49.374126 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6b95f6d6-b3f9-429a-a59d-b67e4ff65526 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:49.383387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6b95f6d6-b3f9-429a-a59d-b67e4ff65526 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1221 microversion: 2.1 time: 0.710266 May 12 14:37:49.384039 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d812329c-4bc6-40cc-b614-6c72c10432d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 1.013003 May 12 14:37:49.391855 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 11/28] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:48 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1221 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:49.392233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 18/29] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:48 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:50.345312 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2ab3cfec-06c7-4a45-81db-98fe5fe022ed tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'create', calling method: .version_select at 0x7f4651faa280>, body: {"keypair": {"name": "tempest-keypair-1750619581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi7JVA3FNQiEsfXz90MdLM41AgfXUHYayBgFEPt9m1QWsx7/Y4YRlprpTbUbOlTulLxSgZ4cEvFGEoBAIv+2PZF4Jhk5nGQ69DfXZIXdi+hQCpvA9Ee5SG7PXyzs4NwVA=="}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:50.384207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-2ab3cfec-06c7-4a45-81db-98fe5fe022ed tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:37:50.422635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-2ab3cfec-06c7-4a45-81db-98fe5fe022ed tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for user 8d318a968c834567a30e9788e752cdc6 and project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:37:50.496469 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2ab3cfec-06c7-4a45-81db-98fe5fe022ed tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.096621 May 12 14:37:50.497396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 19/30] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:37:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:37:50.509432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-62089459", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:50.635880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.network.neutron [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] validate_networks() for [('50fb2d7f-8dca-4e62-9436-b1a9279da276', None, None, None, None, None)] {{(pid=123725) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:37:51.249069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c387c304-d53b-49e4-8100-efbf796337bb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'create', calling method: .version_select at 0x7f465170eb80>, body: {"keypair": {"name": "tempest-keypair-773548342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFypF0jEXXzkFhaZ9weEHChnYCZklJI5GYmH4B6rDGXeIw82qIKR8J4Dkasq73AD6Q8Dr/tZQw1y3PWQ4ty3wQl1sWF9yvkY6oXI8xq6X037UFUyGHBp1BNocaroQLo+aA=="}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:51.373132 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-c387c304-d53b-49e4-8100-efbf796337bb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:37:51.400210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-c387c304-d53b-49e4-8100-efbf796337bb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for user f7b41d1655e24cf0b1f4bda137115af4 and project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:37:51.512999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c387c304-d53b-49e4-8100-efbf796337bb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 2.107848 May 12 14:37:51.516156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 12/31] 10.222.0.79 () {62 vars in 1199 bytes} [Thu May 12 14:37:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 2116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 14:37:51.551673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:51.560082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:51.609205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:51.610802 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:51.619134 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:51.619134 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:53.077192 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:53.101273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-bb5d7aa8-08b9-43d6-b3ea-ac2a3310a0ac tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 1.583832 May 12 14:37:53.102501 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 13/32] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:51 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:54.124042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:54.124937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:54.140319 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:54.141648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:54.170935 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:54.172016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:57.024561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Flavor limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:37:57.026487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Image limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:37:57.027550 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Flavor pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:37:57.028269 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Image pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:37:57.029048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:37:57.052344 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:57.053098 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:57.057435 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:57.058142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:57.059359 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:57.066973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b60c2bb0-ebd6-44f0-b9c5-95f14a2eae69 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 2.950948 May 12 14:37:57.074239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 14/33] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:54 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 2960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:57.113865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:37:57.120863 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for user 99075fda1c7d4e7698e2062407bc2433 and project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:37:57.142655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Going to run 1 instances... {{(pid=123725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:37:57.146399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:37:57.321290 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6100f35f-5e68-4f9c-a9e2-315f4b21ea81 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.822584 May 12 14:37:57.322324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 20/34] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:37:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 6824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:37:57.369235 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-216069749", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "272339fb-b619-4ece-94ff-5fe15c567402"}], "security_groups": [{"name": "tempest-securitygroup--404585001"}], "key_name": "tempest-keypair-773548342", "user_data": "}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:57.749903 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-a06fb2af-31a7-4d6b-b9e7-c9f5f0497d5d req-a7c68fea-ec54-4828-bfd6-6066c0574d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0019df15-8d39-44b1-88e4-2fa86532c89f", "tag": "6576f263-e0eb-4c77-b47c-9fd54ff6acce"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:57.801136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-a06fb2af-31a7-4d6b-b9e7-c9f5f0497d5d req-a7c68fea-ec54-4828-bfd6-6066c0574d0d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:57.802090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-a06fb2af-31a7-4d6b-b9e7-c9f5f0497d5d req-a7c68fea-ec54-4828-bfd6-6066c0574d0d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:57.912104 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-a06fb2af-31a7-4d6b-b9e7-c9f5f0497d5d req-a7c68fea-ec54-4828-bfd6-6066c0574d0d service nova] Creating event network-changed:6576f263-e0eb-4c77-b47c-9fd54ff6acce for instance 0019df15-8d39-44b1-88e4-2fa86532c89f on hv-cinder-84067 May 12 14:37:57.927987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-a06fb2af-31a7-4d6b-b9e7-c9f5f0497d5d req-a7c68fea-ec54-4828-bfd6-6066c0574d0d service nova] Acquired lock "compute-rpcapi-router" {{(pid=123726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 14:37:57.930745 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36c6cc4-e279-48ec-a18f-4dc42d1e9a0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:57.931711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36c6cc4-e279-48ec-a18f-4dc42d1e9a0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:57.934970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36c6cc4-e279-48ec-a18f-4dc42d1e9a0e None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:57.937437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36c6cc4-e279-48ec-a18f-4dc42d1e9a0e None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:58.018655 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.compute.rpcapi [None req-a36c6cc4-e279-48ec-a18f-4dc42d1e9a0e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 14:37:58.020120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36c6cc4-e279-48ec-a18f-4dc42d1e9a0e None None] Releasing lock "compute-rpcapi-router" {{(pid=123726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 14:37:58.072907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a36c6cc4-e279-48ec-a18f-4dc42d1e9a0e None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.996094 May 12 14:37:58.104804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 15/35] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:37:58.127241 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c2c84b4b-27ce-4265-9654-dd35a2f8e1e7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:58.131124 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c2c84b4b-27ce-4265-9654-dd35a2f8e1e7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:58.324593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.network.neutron [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] validate_networks() for [('272339fb-b619-4ece-94ff-5fe15c567402', None, None, None, None, None)] {{(pid=123725) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:37:58.713671 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c2c84b4b-27ce-4265-9654-dd35a2f8e1e7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:58.727520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c2c84b4b-27ce-4265-9654-dd35a2f8e1e7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1220 microversion: 2.1 time: 0.638390 May 12 14:37:58.732114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 16/36] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:58 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1220 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:58.746678 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:58.748559 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:58.764473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:58.765671 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:58.766776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:58.767347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:00.202360 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:00.214558 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-671a4794-7898-4876-a05b-dcb0ebcad2a5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 1.480480 May 12 14:38:00.217697 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 17/37] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:37:58 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:00.222659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:00.230718 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:00.249893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:00.250565 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:00.251494 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:00.252089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:00.455779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:00.463771 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-50ab51af-d51a-4186-8fbc-61593a1e80c5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1272 microversion: 2.1 time: 0.244836 May 12 14:38:00.473628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 18/38] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:00 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:00.839417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1375492117", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d1d321-0090-41ca-9dd0-9f717585a523"}], "security_groups": [{"name": "tempest-securitygroup--2021136509"}], "key_name": "tempest-keypair-36731124", "user_data": "}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:01.217207 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] validate_networks() for [('45d1d321-0090-41ca-9dd0-9f717585a523', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:38:01.532755 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Flavor limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:01.533243 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Image limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:01.533653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Flavor pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:01.534068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Image pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:01.534485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:01.571750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:01.572382 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:01.578750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:01.579266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:01.660402 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:01.677924 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for user f7b41d1655e24cf0b1f4bda137115af4 and project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:01.747500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Going to run 1 instances... {{(pid=123725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:01.749725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:01.924790 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9dae21c9-5326-4e88-9f68-8597a1733013 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.598155 May 12 14:38:01.951819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 21/39] 10.222.0.79 () {62 vars in 1187 bytes} [Thu May 12 14:37:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 4626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 14:38:01.965477 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:01.967469 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:01.991595 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:01.992828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:01.994064 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:01.996170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.205452 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:03.214095 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e268a91e-92fc-4672-93d0-89852ca228ad tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 1.260876 May 12 14:38:03.214693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 22/40] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:01 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:03.228440 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:03.229267 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:03.235832 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:03.236519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.237413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:03.238067 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.373203 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:03.380961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b929316f-5ac2-4613-b612-cda4d4424730 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1280 microversion: 2.1 time: 0.156216 May 12 14:38:03.381899 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 23/41] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:03 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:03.387062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:03.387909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:03.396289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:03.397042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.398012 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:03.398740 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.417255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:03.420296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:03.421027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:03.421749 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:03.422639 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:03.442989 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:03.444422 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.445583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:03.446027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.467857 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:03.470686 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:03.477357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:03.479463 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:03.481771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:03.483575 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cc1362de-ac90-4c5c-b2ab-826ab8f28feb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1284 microversion: 2.20 time: 0.100244 May 12 14:38:03.484587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 24/42] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:03 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:03.502023 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-334514488", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4082a23-e2c1-47cf-8408-55f5d6e4d99e"}], "security_groups": [{"name": "tempest-securitygroup--776200903"}], "key_name": "tempest-keypair-1750619581", "user_data": "}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:03.507914 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:03.510666 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:03.596753 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-49b53857-015d-4b79-973b-2fbae92a784e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.761927 May 12 14:38:03.603985 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 19/43] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:38:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:38:03.614111 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-84a1433d-6f1c-4dc7-99c8-17392884836b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:03.614750 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-84a1433d-6f1c-4dc7-99c8-17392884836b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:03.706771 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-84a1433d-6f1c-4dc7-99c8-17392884836b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:03.715282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-84a1433d-6f1c-4dc7-99c8-17392884836b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1240 microversion: 2.1 time: 0.105383 May 12 14:38:03.720859 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 20/44] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:03 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:03.817157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.network.neutron [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] validate_networks() for [('e4082a23-e2c1-47cf-8408-55f5d6e4d99e', None, None, None, None, None)] {{(pid=123725) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:38:04.223234 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-507b409c-b604-4f2a-99a2-aed2289a368f req-c8c053a2-dbc9-42df-9219-a6f83a81fa74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe4da68-32b7-45fc-930e-651d23fc4595", "tag": "94227bdb-a088-403e-92ec-13093a4ba02d"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:04.265321 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-507b409c-b604-4f2a-99a2-aed2289a368f req-c8c053a2-dbc9-42df-9219-a6f83a81fa74 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.275637 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-507b409c-b604-4f2a-99a2-aed2289a368f req-c8c053a2-dbc9-42df-9219-a6f83a81fa74 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.310884 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-507b409c-b604-4f2a-99a2-aed2289a368f req-c8c053a2-dbc9-42df-9219-a6f83a81fa74 service nova] Creating event network-changed:94227bdb-a088-403e-92ec-13093a4ba02d for instance 1fe4da68-32b7-45fc-930e-651d23fc4595 on hv-cinder-84067 May 12 14:38:04.321497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-507b409c-b604-4f2a-99a2-aed2289a368f req-c8c053a2-dbc9-42df-9219-a6f83a81fa74 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108049 May 12 14:38:04.325914 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 21/45] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:04.340750 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:04.342794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:04.375356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.377417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.379388 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.382100 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.487484 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:05.502927 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Flavor limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:05.503441 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Image limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:05.504031 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2864fd64-292a-41f7-a16c-6b1125db4744 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 1.175653 May 12 14:38:05.504823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Flavor pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:05.505347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Image pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:05.505762 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:05.515557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 22/46] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:04 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:05.518848 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.522181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.522734 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:05.523729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:05.523888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.525261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.534197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.534947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.536089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.537191 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.578455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:05.582804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for user 8d318a968c834567a30e9788e752cdc6 and project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:05.595508 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Going to run 1 instances... {{(pid=123725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:05.610257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:05.744815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:05.754499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f90c4ca0-6f9e-4f70-a2a2-ae49cb25ceee tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1278 microversion: 2.1 time: 0.236805 May 12 14:38:05.760345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 23/47] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:05 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:05.762505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-42e9a258-a85f-4a28-a2ba-9f7558975775 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.276175 May 12 14:38:05.777626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 25/48] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:38:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:38:05.782647 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:05.784548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:05.790029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:05.797844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:05.805927 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.812878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.813606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.814131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.821215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.825084 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.826745 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.829826 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:06.078110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:06.097037 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:06.105390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:06.108970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-94c7a098-9cdd-4d99-8aa7-a93b353d88cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1350 microversion: 2.20 time: 0.347402 May 12 14:38:06.113453 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:05 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1350 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:06.126350 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-47d6d369-72b6-4315-b8fa-62cd50d5c893 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:06.135499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-47d6d369-72b6-4315-b8fa-62cd50d5c893 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:06.336975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:06.346386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-713ec66d-196b-45fb-8bee-1f81cbab90e2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1300 microversion: 2.1 time: 0.575060 May 12 14:38:06.352789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 26/50] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:05 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1300 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:06.436786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-47d6d369-72b6-4315-b8fa-62cd50d5c893 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:06.454000 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-47d6d369-72b6-4315-b8fa-62cd50d5c893 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1237 microversion: 2.1 time: 0.336479 May 12 14:38:06.458213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 25/51] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:06 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1237 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:06.522975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:06.523621 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:06.537265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.544062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:06.552395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.555767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:06.776212 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:06.777839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:06.793928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.796671 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:06.799040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.802433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.027343 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.034945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5799b0cc-76d4-4388-aaa0-b068a92640d9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1278 microversion: 2.1 time: 0.264606 May 12 14:38:07.035537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 26/52] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:06 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:07.129545 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:07.130093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:07.144764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:07.145235 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.146016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:07.146441 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.249348 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.260598 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-567339c8-4044-4e3f-aa96-b5fcd62cdb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.740993 May 12 14:38:07.262823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 27/53] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:06 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:07.328786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.343076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.346570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.348506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0404bf03-55f4-4f19-bc97-fef590558199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1338 microversion: 2.20 time: 0.223285 May 12 14:38:07.361040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 27/54] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:07 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:07.370819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:07.371889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:07.382774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:07.384390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.386612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:07.388480 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.474957 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:07.475839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:07.482957 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:07.492663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.499958 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:07.500642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.572303 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.597591 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4b01968b-1b42-4356-94a7-deeb8963fda1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1298 microversion: 2.1 time: 0.231293 May 12 14:38:07.606880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 28/55] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:07 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1298 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:07.893156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.902938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-92f87a0d-b6f6-4696-97f8-3fbe878ddf80 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1289 microversion: 2.1 time: 0.431937 May 12 14:38:07.907651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 28/56] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:07 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1289 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:08.058647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:08.059597 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:08.098601 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.099071 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.105748 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.108172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.285546 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:08.294304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:08.317902 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.318690 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.319947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.323577 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.978686 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:08.989741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fad97956-fd2a-4a6e-9996-4e46b0e33925 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.938960 May 12 14:38:08.991843 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 29/57] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:08 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:08.997275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:08.998591 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:09.008897 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.009723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.013242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.014462 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.055355 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:09.066824 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fac07e5e-5008-4744-981a-131abe361bd8 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.791536 May 12 14:38:09.068616 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 29/58] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:08 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:09.082315 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:09.083197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:09.090570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.091019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.091831 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.092273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.191145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:09.206746 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f6f9a62a-cff3-4dfc-8880-b2731ab59498 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1298 microversion: 2.1 time: 0.136825 May 12 14:38:09.216245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 30/59] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:09 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:09.368376 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:09.386250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:09.388170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:09.389557 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-30bc5e3b-95b0-4629-80c4-84649d1cfa7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.396348 May 12 14:38:09.390216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 30/60] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:08 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:09.394930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:09.395627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:09.406577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.408151 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.409596 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.410251 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.451559 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-e12c54f9-e858-4af6-95ff-3f720b32a252 req-0c3231f9-461f-43e2-bc52-d52948b58648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0019df15-8d39-44b1-88e4-2fa86532c89f", "name": "network-vif-plugged", "status": "completed", "tag": "6576f263-e0eb-4c77-b47c-9fd54ff6acce"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:09.460946 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-e12c54f9-e858-4af6-95ff-3f720b32a252 req-0c3231f9-461f-43e2-bc52-d52948b58648 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.461390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-e12c54f9-e858-4af6-95ff-3f720b32a252 req-0c3231f9-461f-43e2-bc52-d52948b58648 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.483076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-e12c54f9-e858-4af6-95ff-3f720b32a252 req-0c3231f9-461f-43e2-bc52-d52948b58648 service nova] Creating event network-vif-plugged:6576f263-e0eb-4c77-b47c-9fd54ff6acce for instance 0019df15-8d39-44b1-88e4-2fa86532c89f on hv-cinder-84067 May 12 14:38:09.504636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-e12c54f9-e858-4af6-95ff-3f720b32a252 req-0c3231f9-461f-43e2-bc52-d52948b58648 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294986 May 12 14:38:09.505552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 31/61] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:09.929750 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-fcf0beec-29ed-4f1b-a512-f6b4fc21ec32 req-57ea6c6d-25a0-4b9d-90c7-8ea0bfc6eee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dbaf2e7-9702-48d5-8a0e-5088f269f7f1", "tag": "b36316ae-0793-416c-9119-9819353b009c"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:09.941698 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-fcf0beec-29ed-4f1b-a512-f6b4fc21ec32 req-57ea6c6d-25a0-4b9d-90c7-8ea0bfc6eee2 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.942856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-fcf0beec-29ed-4f1b-a512-f6b4fc21ec32 req-57ea6c6d-25a0-4b9d-90c7-8ea0bfc6eee2 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.966728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-fcf0beec-29ed-4f1b-a512-f6b4fc21ec32 req-57ea6c6d-25a0-4b9d-90c7-8ea0bfc6eee2 service nova] Creating event network-changed:b36316ae-0793-416c-9119-9819353b009c for instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 on hv-cinder-84067 May 12 14:38:09.981209 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-fcf0beec-29ed-4f1b-a512-f6b4fc21ec32 req-57ea6c6d-25a0-4b9d-90c7-8ea0bfc6eee2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194383 May 12 14:38:09.981837 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 32/62] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:10.023884 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:10.025173 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:10.042277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.043057 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.044368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.045973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.062167 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:10.087057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c5890951-7e33-43f5-b40c-80fc88bc2046 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.695471 May 12 14:38:10.087818 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 31/63] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:09 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:10.092743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:10.093354 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:10.102584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.103092 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.103955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.104780 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.368018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:10.375284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:10.375798 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7a4fb431-2863-4606-b8b1-771d5905a685 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.371802 May 12 14:38:10.376773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 33/64] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:10 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:10.384363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:10.384363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:10.388654 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.389370 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.390056 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.390558 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.390943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9babc95e-557c-46f0-bbf8-78a3ff3a2ea6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.302090 May 12 14:38:10.391748 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 32/65] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:10 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:10.411629 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:10.412425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:10.420408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.420922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.422556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.422995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.622274 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:10.631756 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7c17ba97-de91-4ca2-b496-b8a3befea512 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.253784 May 12 14:38:10.632930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 34/66] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:10 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:10.638501 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:10.647128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:10.648640 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:10.651712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-1a5862b8-a471-45cc-a3d6-af712af31190 req-302f8df5-8b17-400d-aa8a-957838b084d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71021fe5-ffce-4c41-8578-8c810987915c", "tag": "b7400c71-756f-4d64-b80c-1f914eadab6d"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:10.654076 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c930923f-69c1-4840-9d13-b60652809d93 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.248912 May 12 14:38:10.657650 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:10 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:38:10.664197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-1a5862b8-a471-45cc-a3d6-af712af31190 req-302f8df5-8b17-400d-aa8a-957838b084d2 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.664638 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-1a5862b8-a471-45cc-a3d6-af712af31190 req-302f8df5-8b17-400d-aa8a-957838b084d2 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.676401 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-1a5862b8-a471-45cc-a3d6-af712af31190 req-302f8df5-8b17-400d-aa8a-957838b084d2 service nova] Creating event network-changed:b7400c71-756f-4d64-b80c-1f914eadab6d for instance 71021fe5-ffce-4c41-8578-8c810987915c on hv-cinder-84067 May 12 14:38:10.681183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-1a5862b8-a471-45cc-a3d6-af712af31190 req-302f8df5-8b17-400d-aa8a-957838b084d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046965 May 12 14:38:10.681916 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 35/68] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:11.104556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.105187 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.115414 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.116025 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.117271 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.118299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.328831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.337527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0a3ca347-14d2-4a57-b657-3e34b26287d7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.237251 May 12 14:38:11.338115 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 34/69] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:11 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:11.393711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.394839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.401563 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.402013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.402941 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.403564 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.408378 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.408983 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.415061 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.415620 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.416425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.416851 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.660948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.668793 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2c9ec5a9-d3f9-4574-b87a-010155233ab5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.279527 May 12 14:38:11.669676 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 36/70] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:11 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:11.670211 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.674896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.676321 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.678700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7a8af6a9-4ec7-47fa-a975-9ada5be15f7a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.274150 May 12 14:38:11.679752 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 35/71] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:11 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:11.683180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.683720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.684469 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.684752 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.685269 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.685614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.692029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.692484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.693266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.693709 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.903876 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.906561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.912647 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-608cf547-6450-4f38-a691-1ef99f7bcbd5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.240874 May 12 14:38:11.915047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.917005 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.918428 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-09e0e1cc-499e-46f3-9ce9-71951c7c73c5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.237746 May 12 14:38:11.924470 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 37/72] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:11 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:11.939152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 36/73] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:11 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:12.355204 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.355839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.361893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.362339 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.363214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.363653 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.508013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:12.519365 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-549ba7f6-f091-492c-a5ca-1aee8dbb86e6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.167856 May 12 14:38:12.520254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 38/74] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:12.687232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.687850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.695125 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.695532 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.696472 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.696584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.697185 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.697311 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.703953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.704533 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.706361 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.707628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.906401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:12.910729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:12.915116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8351c2f3-afbe-44d7-a253-9117783e4bc8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.232099 May 12 14:38:12.915719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 37/75] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:12.918835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5a0f7fc3-3456-4ea1-af7b-cea61107ab7d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.225998 May 12 14:38:12.919388 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 39/76] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:12.933739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.934356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.937375 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.938038 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.940260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.941674 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.942166 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.942759 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.944662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.945195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.946156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.946782 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.164425 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:13.176579 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:13.185491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:13.188485 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-30f1eb05-ddf0-447e-944c-15e79e357e51 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.254879 May 12 14:38:13.190210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 40/77] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:13.201027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:13.205921 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-94442ca3-9565-4f1e-a089-81e3d4d9ae89 req-084b1f3d-ced7-4d78-b109-58e43f5a88a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843e0ce-6156-4d75-9341-c049c6297133", "tag": "4e5a3761-d09e-48c6-943e-29a687c9f984"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:13.209230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-521274c9-e8b7-4638-9db1-acc8d0e78e45 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.279176 May 12 14:38:13.210426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 38/78] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:13.217743 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-94442ca3-9565-4f1e-a089-81e3d4d9ae89 req-084b1f3d-ced7-4d78-b109-58e43f5a88a6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.218179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-94442ca3-9565-4f1e-a089-81e3d4d9ae89 req-084b1f3d-ced7-4d78-b109-58e43f5a88a6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.229449 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-94442ca3-9565-4f1e-a089-81e3d4d9ae89 req-084b1f3d-ced7-4d78-b109-58e43f5a88a6 service nova] Creating event network-changed:4e5a3761-d09e-48c6-943e-29a687c9f984 for instance f843e0ce-6156-4d75-9341-c049c6297133 on hv-cinder-84067 May 12 14:38:13.235473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-94442ca3-9565-4f1e-a089-81e3d4d9ae89 req-084b1f3d-ced7-4d78-b109-58e43f5a88a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033855 May 12 14:38:13.236127 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 41/79] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:13.538271 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:13.538990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:13.545275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.545821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.546660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.547115 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.677527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:13.684933 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2629659c-a976-48df-b7ef-d534b36c400b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.150648 May 12 14:38:13.685520 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 39/80] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:13 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:13.938016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:13.939130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:13.940248 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:13.941908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:13.951745 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.952316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.952560 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.953100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.953875 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.954341 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.954598 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.955050 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.151114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.158945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.159093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0a937249-7ce9-4ec8-87ec-9c47783d2ef5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.225700 May 12 14:38:14.159893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 40/81] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:13 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:14.173724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2a3dd8a9-076a-4aa8-be74-8e3bb85548e6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.242555 May 12 14:38:14.174278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 42/82] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:13 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:14.206679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:14.207337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.213793 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.216304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.217254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.217772 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.227083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:14.227675 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.233658 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.234115 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.234878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.235307 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.408069 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.419282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.421370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.423197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-11eb818f-ead1-4a32-b4a2-84658818bdba tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.220446 May 12 14:38:14.423948 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 41/83] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:14 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:14.429591 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-849918156", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "networks": [{"uuid": "d2bf7750-7a0c-4b6b-91bb-068ee7291c5b"}]}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:14.433369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.441142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5cbb41cf-8e6c-4d6c-a119-bd76e9af9479 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.217646 May 12 14:38:14.442075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 43/84] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:14 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:14.483746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.network.neutron [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] validate_networks() for [('d2bf7750-7a0c-4b6b-91bb-068ee7291c5b', None, None, None, None, None)] {{(pid=123725) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:38:14.702922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:14.703774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.713113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.713710 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.714847 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.715360 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.206578 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:15.215787 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-06217d5a-39fe-40ca-b0bf-e5a8cd76e801 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.516737 May 12 14:38:15.216319 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 44/85] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:14 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:15.221797 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:15.223724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:15.231024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.231490 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.232274 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.232880 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.775366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:15.789712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-16869312-253f-47a0-b2c2-c28c403b408c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.572158 May 12 14:38:15.790304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 45/86] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:15 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:15.796846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:15.797463 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:15.804768 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.805239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.805980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.806569 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.995969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Flavor limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:15.996453 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Image limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:15.997012 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Flavor pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:15.997445 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Image pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:15.997869 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:16.007195 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.007633 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.008480 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.008912 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.027926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Getting quotas for project eeba321debcd40e6ba9eb9a5c1e534ce. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:16.031875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Getting quotas for user 35fc8699f921492282b5be9b5fab5b24 and project eeba321debcd40e6ba9eb9a5c1e534ce. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:16.043130 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Going to run 1 instances... {{(pid=123725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:16.045642 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:16.072566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.083928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8e6d9a8c-bdc2-43b6-90ec-14aa244a0590 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.292496 May 12 14:38:16.094714 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 46/87] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:15 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:16.100412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:16.101002 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:16.102922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1468cea4-a569-40ab-ab6a-fb28b56b9c5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677581 May 12 14:38:16.107990 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.108664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.109583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.109739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 42/88] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:38:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:38:16.110309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.116298 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:16.117161 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:16.124563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.125403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.127587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.128930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.382546 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.399520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.408707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.411184 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fec169db-f218-468a-aa58-af17600c7347 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.314962 May 12 14:38:16.426980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 47/89] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:16 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:16.432134 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fd4d5910-3e09-4419-b648-f060c5c83ec5 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:16.433376 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fd4d5910-3e09-4419-b648-f060c5c83ec5 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:16.566952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fd4d5910-3e09-4419-b648-f060c5c83ec5 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.574786 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.576836 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fd4d5910-3e09-4419-b648-f060c5c83ec5 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1213 microversion: 2.1 time: 0.148335 May 12 14:38:16.577421 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 48/90] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:16 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:16.585551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c1581a29-b48f-45b5-8836-cde2dcc6d2e5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.474419 May 12 14:38:16.586632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 43/91] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:16 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:16.594945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:16.595754 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:16.603161 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.603616 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.604647 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.605272 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.697134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-957d3855-a1fd-4137-ac39-19bf0f3ac092 req-6f16a025-637a-4b76-bb62-5811e12f79e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98650df-7034-4d31-ad93-f9a133863781", "tag": "cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:16.714517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-957d3855-a1fd-4137-ac39-19bf0f3ac092 req-6f16a025-637a-4b76-bb62-5811e12f79e4 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.715092 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-957d3855-a1fd-4137-ac39-19bf0f3ac092 req-6f16a025-637a-4b76-bb62-5811e12f79e4 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.735208 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-957d3855-a1fd-4137-ac39-19bf0f3ac092 req-6f16a025-637a-4b76-bb62-5811e12f79e4 service nova] Creating event network-changed:cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0 for instance e98650df-7034-4d31-ad93-f9a133863781 on hv-cinder-84067 May 12 14:38:16.736083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-957d3855-a1fd-4137-ac39-19bf0f3ac092 req-6f16a025-637a-4b76-bb62-5811e12f79e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 14:38:16.737801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-04f3e137-df51-4431-bae3-57aeae05a7f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.738486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-04f3e137-df51-4431-bae3-57aeae05a7f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.739960 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-04f3e137-df51-4431-bae3-57aeae05a7f4 None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.740569 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-04f3e137-df51-4431-bae3-57aeae05a7f4 None None] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.750363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.compute.rpcapi [None req-04f3e137-df51-4431-bae3-57aeae05a7f4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 14:38:16.751643 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-04f3e137-df51-4431-bae3-57aeae05a7f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 14:38:16.784713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-04f3e137-df51-4431-bae3-57aeae05a7f4 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093862 May 12 14:38:16.786186 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 44/92] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:16.807985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:16.808943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:16.813860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.823175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0355235b-1589-4ca9-a845-40b0e07ff645 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.237836 May 12 14:38:16.825415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 49/93] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:16 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:16.851797 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.852249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.853028 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.853460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.083766 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-5239995d-7b81-41db-8f44-27bb88bcbf19 req-81292a8d-99c9-48b6-8a5c-5aeffa0fd44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe4da68-32b7-45fc-930e-651d23fc4595", "name": "network-vif-plugged", "status": "completed", "tag": "94227bdb-a088-403e-92ec-13093a4ba02d"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:17.100949 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-5239995d-7b81-41db-8f44-27bb88bcbf19 req-81292a8d-99c9-48b6-8a5c-5aeffa0fd44b service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.101515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-5239995d-7b81-41db-8f44-27bb88bcbf19 req-81292a8d-99c9-48b6-8a5c-5aeffa0fd44b service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.123111 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.134541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-87e48671-a584-45b6-8c9a-086126344e0c tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.330956 May 12 14:38:17.135225 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-5239995d-7b81-41db-8f44-27bb88bcbf19 req-81292a8d-99c9-48b6-8a5c-5aeffa0fd44b service nova] Creating event network-vif-plugged:94227bdb-a088-403e-92ec-13093a4ba02d for instance 1fe4da68-32b7-45fc-930e-651d23fc4595 on hv-cinder-84067 May 12 14:38:17.136347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 45/94] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:16 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:17.148208 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-5239995d-7b81-41db-8f44-27bb88bcbf19 req-81292a8d-99c9-48b6-8a5c-5aeffa0fd44b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069012 May 12 14:38:17.149138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 50/95] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:17.149981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.150765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.168296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.169011 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.170264 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.170830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.362791 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.373312 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6a853df9-a2b0-4c9d-9db5-a610412ec3a7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.235065 May 12 14:38:17.373897 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 46/96] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:17.430499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.431211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.437764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.438205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.438967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.439396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.577877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.586035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.587678 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.588981 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7bfb1cc2-5bef-460b-83e1-21e3bcf3d190 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.162895 May 12 14:38:17.589708 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 51/97] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:17.594252 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.594896 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.602297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.602719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.603222 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.603521 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.603991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.604094 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.610348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.610786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.611732 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.612330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.701663 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.709416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8e1aed42-dce0-4d89-aecc-296c87a9445b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1217 microversion: 2.1 time: 0.118846 May 12 14:38:17.710300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 47/98] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:17.843777 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.844696 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.851354 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.852207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.853228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.853859 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.999443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.008396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-37cb309a-0df5-4e08-8df5-bb84d99289b1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.409292 May 12 14:38:18.008905 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 52/99] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:18.045988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.053679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-02c4d2d1-a189-4df3-9bbe-6da9ca89b694 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.216660 May 12 14:38:18.054259 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 48/100] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:18.153069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:18.153756 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:18.161064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.161515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.162292 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.162725 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.294236 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.302434 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5640ea55-4073-48c6-bb0b-760f7702e5df tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.153311 May 12 14:38:18.303101 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 53/101] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:18 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:18.390600 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:18.391217 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:18.397776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.398230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.399001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.399436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.545013 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.555783 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e95621d1-f39c-4698-84ea-0823bc7dd9e0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.169043 May 12 14:38:18.556644 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 49/102] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:18 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:18.607380 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:18.608199 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:18.614215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.614835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.615604 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.616060 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.727159 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:18.728216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:18.740176 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.740586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.741765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.742233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.807822 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.821109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.823438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.826023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b46e5f4b-57f6-4ed8-a09b-bacb82e99efc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.222474 May 12 14:38:18.826805 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 54/103] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:18 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:18.827750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.836040 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-93dfa72a-e857-4262-91ef-bf35cdfedb23 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1217 microversion: 2.1 time: 0.113169 May 12 14:38:18.836608 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 50/104] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:18 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:19.025669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.026106 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.032154 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.032598 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.033360 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.033785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.071124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.071766 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.085910 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.086884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.088062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.088934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.224246 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:19.232180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b2bf59b6-2d6a-468a-b533-73aef5dce3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.210330 May 12 14:38:19.232746 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 55/105] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:19.259135 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:19.266551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2f5887e0-c55e-4783-8521-9bd43109c8e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.200009 May 12 14:38:19.267128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 51/106] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:19.318844 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.319444 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.325457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.325894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.326682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.327112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.574293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.575317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.583300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.583769 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.585005 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.586003 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.593359 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:19.601392 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f74f510e-6749-4b2b-9ed8-69d6cd0a4238 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1315 microversion: 2.1 time: 0.286375 May 12 14:38:19.602192 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 56/107] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:19.724525 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:19.731704 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-858f24fd-0d3a-46cd-af3b-8b0df90a0f74 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.163041 May 12 14:38:19.732314 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 52/108] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:19.846456 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.847830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.853149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.853901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.861497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.862108 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.862512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.862943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.863372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.863613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.864622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.865134 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.980221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:19.993615 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8ad0bb90-ada2-4bb0-8e17-9dc6e9207631 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1209 microversion: 2.1 time: 0.144094 May 12 14:38:19.994433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 53/109] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:20.112881 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.130779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.135570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.137659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b01c6e1f-2c99-46b8-a94a-f5dacd06838e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.295054 May 12 14:38:20.142550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 57/110] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:20.251737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:20.252513 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:20.265889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.266685 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.270431 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.270878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.284336 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:20.284973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:20.298721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.299162 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.299992 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.305930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.640062 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.642992 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.647911 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5ca9e77f-6775-46b0-b6bd-b3b2e7a0b446 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.367501 May 12 14:38:20.648499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 58/111] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:20 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:20.651990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a8f94a5b-a80c-45b1-bdee-e0a73933c298 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.404472 May 12 14:38:20.653016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:20.653874 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:20.660419 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.660864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.660964 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 54/112] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:20 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:20.661625 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.662051 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.748547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:20.749169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:20.755561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.756043 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.756826 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.757260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.807608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.815249 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9dde2d3a-4c3c-42c3-9bed-af155f9f7b66 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1502 microversion: 2.1 time: 0.165776 May 12 14:38:20.816263 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 59/113] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:20 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:20.909515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.918481 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-14b90a37-2d0b-45cc-ab1b-8de942a4d740 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.173772 May 12 14:38:20.919068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 55/114] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:20 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:21.010766 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.011377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.021525 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-080e598b-d28b-4673-a41c-20b27458c2f3 req-16d02d38-51e0-4b3f-847f-4a31d79e6dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbaf2e7-9702-48d5-8a0e-5088f269f7f1", "name": "network-vif-plugged", "status": "completed", "tag": "b36316ae-0793-416c-9119-9819353b009c"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:21.026689 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.027182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.028050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.028475 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.037771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-080e598b-d28b-4673-a41c-20b27458c2f3 req-16d02d38-51e0-4b3f-847f-4a31d79e6dfb service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.038571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-080e598b-d28b-4673-a41c-20b27458c2f3 req-16d02d38-51e0-4b3f-847f-4a31d79e6dfb service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.060003 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-080e598b-d28b-4673-a41c-20b27458c2f3 req-16d02d38-51e0-4b3f-847f-4a31d79e6dfb service nova] Creating event network-vif-plugged:b36316ae-0793-416c-9119-9819353b009c for instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 on hv-cinder-84067 May 12 14:38:21.068015 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-080e598b-d28b-4673-a41c-20b27458c2f3 req-16d02d38-51e0-4b3f-847f-4a31d79e6dfb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050422 May 12 14:38:21.070505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 56/115] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:21.132749 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.140962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7f6f4f19-b3d2-4f01-a99d-eb482d2b578d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1265 microversion: 2.1 time: 0.134148 May 12 14:38:21.141520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 60/116] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:21.158916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.159788 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.165750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.166197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.166964 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.167394 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.308433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.316589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.318073 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.319152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-302748e0-aecd-4965-9a6f-c99220beeabd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.164512 May 12 14:38:21.319738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 57/117] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:21.666238 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.666853 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.668179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.668776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.673532 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.673988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.674757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.675314 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.675785 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.675888 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.676540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.676961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.866622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.870666 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.874963 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8483bb6e-527c-451c-82af-43414e7fbe7c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.212928 May 12 14:38:21.875599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 61/118] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:21.878171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d2dc6c84-e9d2-48fe-b315-d96ceb2b2507 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.213676 May 12 14:38:21.878731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 58/119] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:21.935648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.936283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.943295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.943804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.944556 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.944976 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.091927 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:22.100176 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-354f5d31-2342-455f-934b-33574cf4213b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.168234 May 12 14:38:22.100732 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 62/120] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:22.158876 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:22.159509 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:22.166054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.166509 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.167313 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.167787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.203889 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-568160ec-3475-413d-a8d9-3b8247db8d86 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07eb40e8-56a9-4888-a2a5-433431e218f1"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:22.205029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-568160ec-3475-413d-a8d9-3b8247db8d86 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:22.211656 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-568160ec-3475-413d-a8d9-3b8247db8d86 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.212133 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-568160ec-3475-413d-a8d9-3b8247db8d86 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.212899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-568160ec-3475-413d-a8d9-3b8247db8d86 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.213327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-568160ec-3475-413d-a8d9-3b8247db8d86 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.229706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:22.237173 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-51d3f9e1-20c4-4a8d-a5b6-478fd9435a6c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1265 microversion: 2.1 time: 0.082085 May 12 14:38:22.237808 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 59/121] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:22 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:22.338750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:22.339542 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:22.346375 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.347059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.348016 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.348488 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.484355 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:22.493199 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:22.494704 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:22.495923 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2a8d5ba0-3138-4c3f-b4e4-9764004d9d46 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.161189 May 12 14:38:22.496503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 60/122] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:22 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:22.892397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:22.893424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:22.903922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.904403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.905202 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.905640 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.042480 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.050343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2d6b48b2-e8cb-4531-b6ad-ff0a26afd464 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.161718 May 12 14:38:23.050988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 61/123] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:22 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:23.059179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:23.059940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:23.066248 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.066819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.067762 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.068179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.205590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.216566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8b284a07-77a4-4271-be26-8f6f53b9faf9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.164319 May 12 14:38:23.217369 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 62/124] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:23 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:23.222036 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:23.222707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:23.228660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.229095 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.229893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.230371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.364817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.372261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0db22dc7-8696-4188-a23c-794f36f65dcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.153927 May 12 14:38:23.372841 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 63/125] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:23 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:23.377396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:23.378014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:23.383899 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.384324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.385115 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.385579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.448781 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.459746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4f233ded-d73c-44f8-ac7d-a01036b81430 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1265 microversion: 2.1 time: 0.085495 May 12 14:38:23.460576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 64/126] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:23 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:23.513883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:23.514502 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:23.521006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.521457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.522215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.522645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.653819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.662070 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.663566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.664695 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-36f47da8-90ab-4c46-8223-0d0e0f28e622 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.154666 May 12 14:38:23.665268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 65/127] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:23 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:24.067837 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.068681 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.075861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.076555 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.077728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.078224 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.217035 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.224886 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-033ccc7e-22a1-417a-9803-dd0f8300b713 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.162008 May 12 14:38:24.226034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 66/128] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:24.234105 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.234972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.242780 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.243223 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.244033 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.244471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.386146 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.393519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e14a6a0f-7378-419a-9b07-2d2b8ce1442d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.163472 May 12 14:38:24.394497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 67/129] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:24.398491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.399126 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.405212 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.405660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.406433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.406853 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.533559 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.541090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-299a7d0d-d75e-4d0a-b7d6-094d40c64bcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.146023 May 12 14:38:24.541671 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 68/130] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:24.546589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.547187 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.553280 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.553725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.554491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.554917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.617141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.624575 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f521947c-e7c7-49ea-b9bc-9484cf976b10 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1265 microversion: 2.1 time: 0.081867 May 12 14:38:24.625148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 69/131] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:24.682751 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.683404 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.691055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.691985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.692991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.693443 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.870132 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.879471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.883743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.883743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-28bb3b48-40b1-4ab8-b0c1-d20932a65404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.203825 May 12 14:38:24.883743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 70/132] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:25.242399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:25.243090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:25.249433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.249884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.250682 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.251109 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.636572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-568160ec-3475-413d-a8d9-3b8247db8d86 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "POST /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.436116 May 12 14:38:25.637730 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 63/133] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:38:22 2022] POST /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f/os-volume_attachments => generated 194 bytes in 3438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:25.665811 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:25.666712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:25.676005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.676696 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.678111 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.678976 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.731081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:25.758222 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e18ccdb8-53a1-490a-9623-52b5a08f6a28 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.519825 May 12 14:38:25.771898 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 71/134] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:25 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:25.782139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:25.782797 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:25.794458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.795736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.803174 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.807650 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.268591 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.276748 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e76a5989-5410-4e94-9c77-c0c37002f81a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.637632 May 12 14:38:26.277440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 64/135] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:25 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:26.282105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:26.282774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:26.288783 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.289295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.290245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.290869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.296316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.305408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c323a56d-610a-4641-a609-af00e3b52866 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.532088 May 12 14:38:26.316553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 72/136] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:25 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:26.321996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:26.322887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:26.330055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.330579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.331405 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.331867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.368419 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.377493 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c067178c-da3b-4001-b557-ce9c47912d79 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1271 microversion: 2.1 time: 0.098642 May 12 14:38:26.378157 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 65/137] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:26 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:26.494099 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.502698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.504316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.505426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5c8afc32-5db0-4714-9308-fa7d5a24b23e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.187704 May 12 14:38:26.506253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 73/138] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:26 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:26.776667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:26.777969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:26.785464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.786776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.787934 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.788566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.216264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:27.230524 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6e529de5-febe-4f4e-8339-41e0ba875d0a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.459734 May 12 14:38:27.231899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 66/139] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:26 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:27.294492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:27.295453 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:27.305390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.306060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.308734 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.309153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.323997 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:27.324608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:27.334962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.335402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.336240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.336871 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.766845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:27.775462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c8b32ebc-9611-4958-8d60-a140e8887a27 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.455692 May 12 14:38:27.786003 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 67/140] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:27 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:27.792030 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:27.792880 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:27.804629 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.805567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.806543 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.807828 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.831062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:27.852185 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e80627d9-ec37-4410-a701-1b555f46a755 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.562131 May 12 14:38:27.853402 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 74/141] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:27 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:27.858167 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:27.866343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:27.877624 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.881265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.882121 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.888341 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.945939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:27.957829 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4a466673-ff51-4156-bb09-cb92f18345b2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1271 microversion: 2.1 time: 0.168323 May 12 14:38:27.959438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 68/142] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:27 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:27.969814 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-449bcce0-fcf7-4b5a-89f5-4c0926d83155 req-e8fa3b3e-4f88-4fdb-b284-60eff29bcd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71021fe5-ffce-4c41-8578-8c810987915c", "name": "network-vif-plugged", "status": "completed", "tag": "b7400c71-756f-4d64-b80c-1f914eadab6d"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:27.982646 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-449bcce0-fcf7-4b5a-89f5-4c0926d83155 req-e8fa3b3e-4f88-4fdb-b284-60eff29bcd1d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.983323 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-449bcce0-fcf7-4b5a-89f5-4c0926d83155 req-e8fa3b3e-4f88-4fdb-b284-60eff29bcd1d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.998657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-449bcce0-fcf7-4b5a-89f5-4c0926d83155 req-e8fa3b3e-4f88-4fdb-b284-60eff29bcd1d service nova] Creating event network-vif-plugged:b7400c71-756f-4d64-b80c-1f914eadab6d for instance 71021fe5-ffce-4c41-8578-8c810987915c on hv-cinder-84067 May 12 14:38:28.006235 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-449bcce0-fcf7-4b5a-89f5-4c0926d83155 req-e8fa3b3e-4f88-4fdb-b284-60eff29bcd1d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044762 May 12 14:38:28.007206 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 69/143] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:28.129331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:28.141626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:28.148519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:28.153062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d6b1ad87-1f9e-4697-8d48-27768bf1beff tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.295529 May 12 14:38:28.155715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 75/144] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:27 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:28.250419 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:28.251503 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:28.282695 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.283320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.284404 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.285462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.463145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:28.470556 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-07155273-082b-430c-adba-50b1c904efbc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.225911 May 12 14:38:28.471074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 70/145] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:28 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:28.793204 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:28.794512 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:28.802455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.803156 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.804147 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.804723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.869077 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:28.870751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:28.877901 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.878785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.879638 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.880301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.010523 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.017948 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4193e789-41ff-4503-ad9b-6b30121b38f2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.228538 May 12 14:38:29.018825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 76/146] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:28 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:29.029386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:29.029386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:29.038130 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.039392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.041641 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.042944 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.082555 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.090618 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7bb521ed-6025-4860-8c0c-b5ecf26c7269 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.225343 May 12 14:38:29.091216 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 71/147] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:28 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:29.178554 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:29.182004 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:29.193443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.193890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.197340 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.197842 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.251986 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.261392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f7936d19-7c70-410b-864d-786711911c56 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.241281 May 12 14:38:29.262056 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 77/148] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:29 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:29.427557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.436320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.438035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.439451 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f4ceb280-6ac4-4933-8ce2-9943a0ca0919 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1405 microversion: 2.20 time: 0.266396 May 12 14:38:29.440531 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 72/149] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:29 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:29.491193 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:29.491193 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:29.498650 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.499245 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.500168 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.502138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.732730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.740936 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5d3b5022-6e81-497c-b225-2d6c105ce60a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.256731 May 12 14:38:29.742091 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 78/150] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:29 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:30.028437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-ce829d6e-6795-4396-993b-4a29c78644ae req-512b8aa6-30af-499c-8f27-a408589c82b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843e0ce-6156-4d75-9341-c049c6297133", "name": "network-vif-plugged", "status": "completed", "tag": "4e5a3761-d09e-48c6-943e-29a687c9f984"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:30.039883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.041085 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:30.048712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-ce829d6e-6795-4396-993b-4a29c78644ae req-512b8aa6-30af-499c-8f27-a408589c82b9 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.048993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.049145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-ce829d6e-6795-4396-993b-4a29c78644ae req-512b8aa6-30af-499c-8f27-a408589c82b9 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.049612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.050497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.051077 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.063283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-ce829d6e-6795-4396-993b-4a29c78644ae req-512b8aa6-30af-499c-8f27-a408589c82b9 service nova] Creating event network-vif-plugged:4e5a3761-d09e-48c6-943e-29a687c9f984 for instance f843e0ce-6156-4d75-9341-c049c6297133 on hv-cinder-84067 May 12 14:38:30.069777 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-ce829d6e-6795-4396-993b-4a29c78644ae req-512b8aa6-30af-499c-8f27-a408589c82b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046132 May 12 14:38:30.071154 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 73/151] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:30.109346 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.110067 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:30.116512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.116952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.117705 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.118214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.302391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.318327 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-18d0b3f7-4aeb-4aa9-8cd6-4de63ffeecd5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.279021 May 12 14:38:30.319395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 79/152] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:30.325543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-ce1a7330-f4ce-4406-bc8c-2793a3644fd4 req-5c5927f0-55f3-429e-94ad-35cca04b2d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801b2a6c-d508-4678-ac97-78280c88b6fa", "tag": "9a850fe2-67d9-4c71-95fe-30ee56050c6d"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:30.329344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.337206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-ce1a7330-f4ce-4406-bc8c-2793a3644fd4 req-5c5927f0-55f3-429e-94ad-35cca04b2d48 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.337688 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-ce1a7330-f4ce-4406-bc8c-2793a3644fd4 req-5c5927f0-55f3-429e-94ad-35cca04b2d48 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.337815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4fa068cb-fb42-49b7-9f16-5cacc096f7e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.232713 May 12 14:38:30.339334 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 74/153] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:30.344571 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.345222 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:30.351646 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.352205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.353164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.354093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.372535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-ce1a7330-f4ce-4406-bc8c-2793a3644fd4 req-5c5927f0-55f3-429e-94ad-35cca04b2d48 service nova] Creating event network-changed:9a850fe2-67d9-4c71-95fe-30ee56050c6d for instance 801b2a6c-d508-4678-ac97-78280c88b6fa on hv-cinder-84067 May 12 14:38:30.377878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-ce1a7330-f4ce-4406-bc8c-2793a3644fd4 req-5c5927f0-55f3-429e-94ad-35cca04b2d48 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056862 May 12 14:38:30.379124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 80/154] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:30.461281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.461281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:30.466195 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.466888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.467883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.468494 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.499645 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.509244 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6a01041a-5406-4d06-b721-e1012c0adef0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.168414 May 12 14:38:30.509837 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 75/155] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:30.627585 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.636813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.638323 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.639558 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-da0fc2bf-cf10-48a6-a368-7bc8bda32436 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1597 microversion: 2.20 time: 0.185739 May 12 14:38:30.648266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 81/156] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1597 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:38:30.658305 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-56201fbf-5c70-4e22-8615-c97fbfb689e1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.658778 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-56201fbf-5c70-4e22-8615-c97fbfb689e1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:30.667332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-56201fbf-5c70-4e22-8615-c97fbfb689e1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.667811 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-56201fbf-5c70-4e22-8615-c97fbfb689e1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.668937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-56201fbf-5c70-4e22-8615-c97fbfb689e1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.669374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-56201fbf-5c70-4e22-8615-c97fbfb689e1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.756446 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-56201fbf-5c70-4e22-8615-c97fbfb689e1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102118 May 12 14:38:30.763157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.763157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:30.765110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 76/157] 10.222.0.79 () {60 vars in 1315 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:38:30.772072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.772572 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.773416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.774054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.933418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.941540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e64e6d18-7079-4a67-b758-179f40dae090 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.184152 May 12 14:38:30.942115 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 82/158] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:31.338215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.338829 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.344820 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.345264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.346027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.346662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.356942 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.357549 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.365702 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.366066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.367230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.367918 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.664352 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:31.678424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-321ff789-2b97-401f-9f64-52cbcc031305 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.324306 May 12 14:38:31.681317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 83/159] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:31.688384 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.689731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.692332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:31.698779 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.699549 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.700551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.701684 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.705932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-45d9095f-c0f1-4867-992c-a1c5b4163646 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.370872 May 12 14:38:31.708075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 77/160] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:31.907678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:31.916250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-84d7638d-3edf-40ff-a9c1-7b0fcb644ff7 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.233541 May 12 14:38:31.916851 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 84/161] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:31.959599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.960253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.966586 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.967042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.967851 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.968257 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.122336 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:32.142371 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a2851455-8444-4af4-a185-21f07c8ee671 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.187596 May 12 14:38:32.145304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 78/162] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:32.368698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-7afba993-01ff-4dd6-8fe3-486a250f2609 req-42963ff9-477b-4f90-a3d0-f5ee37feb330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dbaf2e7-9702-48d5-8a0e-5088f269f7f1", "tag": "b36316ae-0793-416c-9119-9819353b009c"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:32.385994 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-7afba993-01ff-4dd6-8fe3-486a250f2609 req-42963ff9-477b-4f90-a3d0-f5ee37feb330 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.386546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-7afba993-01ff-4dd6-8fe3-486a250f2609 req-42963ff9-477b-4f90-a3d0-f5ee37feb330 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.410171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-7afba993-01ff-4dd6-8fe3-486a250f2609 req-42963ff9-477b-4f90-a3d0-f5ee37feb330 service nova] Creating event network-changed:b36316ae-0793-416c-9119-9819353b009c for instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 on hv-cinder-84067 May 12 14:38:32.420497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-7afba993-01ff-4dd6-8fe3-486a250f2609 req-42963ff9-477b-4f90-a3d0-f5ee37feb330 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055462 May 12 14:38:32.421170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 85/163] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:32.698331 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:32.698956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:32.710435 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.711109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.715030 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.715784 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.725978 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:32.726714 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:32.739846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.740293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.741068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.741495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.009882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:33.022040 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-218bd7ee-5356-4a8c-a1b8-1da18a4c1d58 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.301111 May 12 14:38:33.022630 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 86/164] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:32 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:33.035550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:33.043570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7a9c1752-e672-4777-b876-f060e870fe5f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.351136 May 12 14:38:33.044210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 79/165] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:32 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:33.046180 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:33.047212 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:33.053461 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.054124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.055104 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.055505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.161006 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:33.161818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:33.168329 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.169015 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.170463 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.171102 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.285862 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:33.298829 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1ee0e458-ccd2-403d-a78c-06c46b110b3f tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.274705 May 12 14:38:33.299867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 87/166] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:33 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:33.420764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:33.431602 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-99f04983-cfa9-437e-a58b-f9b88148bcc0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.276223 May 12 14:38:33.433391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 80/167] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:33 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:34.041657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:34.043230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:34.052424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.054284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.055273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.056273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.062044 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:34.062766 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:34.074485 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.075136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.078613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.079065 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.329905 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:34.335605 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:34.340089 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8b06010b-a8fd-4834-8186-6b41504cc514 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.303483 May 12 14:38:34.341017 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 88/168] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:34 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:34.345649 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-053eac8a-36a1-4992-a725-a36d5e3d37b1 req-0b575994-bc67-415e-ab27-1bece0f32471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98650df-7034-4d31-ad93-f9a133863781", "name": "network-vif-plugged", "status": "completed", "tag": "cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:34.353997 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-807c03cc-8e8d-4ea0-a310-2ed7833fa88a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.295969 May 12 14:38:34.354222 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-053eac8a-36a1-4992-a725-a36d5e3d37b1 req-0b575994-bc67-415e-ab27-1bece0f32471 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.354521 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-053eac8a-36a1-4992-a725-a36d5e3d37b1 req-0b575994-bc67-415e-ab27-1bece0f32471 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.354807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 81/169] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:34 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:34.365897 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-053eac8a-36a1-4992-a725-a36d5e3d37b1 req-0b575994-bc67-415e-ab27-1bece0f32471 service nova] Creating event network-vif-plugged:cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0 for instance e98650df-7034-4d31-ad93-f9a133863781 on hv-cinder-84067 May 12 14:38:34.370766 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:34.371360 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-053eac8a-36a1-4992-a725-a36d5e3d37b1 req-0b575994-bc67-415e-ab27-1bece0f32471 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029120 May 12 14:38:34.371917 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:34.372186 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 89/170] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:34.379509 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.379984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.380862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.381185 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.450289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:34.451245 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:34.458359 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.459002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.461894 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.462482 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.730442 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:34.740676 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-46c041e2-02ad-43a0-a7fd-f5be2e5a5d0d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.373574 May 12 14:38:34.741557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 82/171] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:34 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:34.753151 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:34.772093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fefb55e9-b262-4d6f-bd21-68e366d21a4e tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.321495 May 12 14:38:34.772856 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 90/172] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:34 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:35.358854 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:35.359559 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:35.370244 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.371156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.371973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.372104 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:35.372624 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:35.373174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.379486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.380283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.381045 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.381707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.996922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:36.014338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:36.023452 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fa21a534-eb88-4701-919f-243272e297dd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.655165 May 12 14:38:36.034320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b8cd6053-83dc-4d89-a4da-aeb97445336c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1320 microversion: 2.1 time: 0.675638 May 12 14:38:36.034320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 83/173] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:35 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1320 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:36.035233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 91/174] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:35 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:36.047188 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:36.047188 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:36.050768 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:36.051649 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:36.057322 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.057998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.058271 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.058902 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.059143 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.059334 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.060544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.061166 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.275051 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:36.280189 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:36.295732 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6ee2d0bf-e34e-498e-91c8-d4669dd678a0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.263843 May 12 14:38:36.307912 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b5b481d1-ccbc-4306-bed3-48761701d561 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.271210 May 12 14:38:36.317377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 84/175] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:36 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:36.321079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 92/176] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:36 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:37.042351 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.042848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.050474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.050918 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.051711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.052142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.054339 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.054946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.060884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.061404 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.062289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.062720 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.245028 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:37.253154 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ee4f688d-d168-4fc7-94eb-944ba620b948 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.214943 May 12 14:38:37.253733 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 85/177] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:37.258585 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:37.269377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8594f91e-60ae-46c2-a7f3-96d9e64caf86 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1513 microversion: 2.1 time: 0.218597 May 12 14:38:37.270219 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 93/178] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:37.292188 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:37.293753 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.302001 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.302448 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.303215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.303651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.324935 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.325552 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.325937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lazy-loading 'flavor' on Instance uuid 71021fe5-ffce-4c41-8578-8c810987915c {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:37.333634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.335235 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.335235 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.335235 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.443909 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8a27f2b2-4826-44eb-8436-40f9a1b971b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c/action" status: 200 len: 32 microversion: 2.1 time: 0.157868 May 12 14:38:37.444834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 86/179] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:38:37 2022] POST /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:38:37.461925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.471999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.477123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:37.480389 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.481026 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.481864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.482303 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.490588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-eb1a0d15-f3b0-4625-b1c7-8f53ab0601ed tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.169405 May 12 14:38:37.500504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 94/180] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:37.505727 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.506488 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.512655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.513317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.514302 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.514881 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.715393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:37.722338 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:37.723529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-faefc221-c121-4cf5-91b8-4a7a97a57513 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.221758 May 12 14:38:37.724160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 95/181] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:37.730468 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4c44cbea-b4a5-4a4b-87ef-1bc9828d7196 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1362 microversion: 2.1 time: 0.284446 May 12 14:38:37.731032 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 87/182] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:38.270517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.271208 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:38.277283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.277907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.278801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.279234 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.502614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:38.507781 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.508917 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:38.510633 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0ec90fa7-dcf0-4174-8756-3444fcf9343c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.244257 May 12 14:38:38.516437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.517100 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.518113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.518691 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.521289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 96/183] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:38 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:38.653794 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.654690 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:38.664289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.665126 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.666408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.667338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.704194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:38:38.808433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:38.816818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f8588df3-7852-49cc-baa1-bc4214081689 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.312783 May 12 14:38:38.817948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 88/184] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:38 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:38.831247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.831992 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:38.838829 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.839460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.840290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.840878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.852298 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6093e196-255a-43ce-9fce-8dad00f3d594 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 204 len: 0 microversion: 2.1 time: 0.203209 May 12 14:38:38.852819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 97/185] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:38:38 2022] DELETE /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:38:38.857852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.858524 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:38.865359 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.865941 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.866718 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.867141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.040681 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.048061 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.048512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-06b5fb83-e996-4d3c-806e-cdbdf3d5dc3d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.229424 May 12 14:38:39.049064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 89/186] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:38 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:39.053933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.054526 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.056495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cbffbd8e-398f-45ff-b93f-3f14bf92dc06 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1548 microversion: 2.1 time: 0.202536 May 12 14:38:39.057375 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 98/187] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:38 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:39.060808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.061248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.062179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.062642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.074894 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6225f639-fa65-455a-938a-8d838f78065a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.075378 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6225f639-fa65-455a-938a-8d838f78065a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.081498 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6225f639-fa65-455a-938a-8d838f78065a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.081940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6225f639-fa65-455a-938a-8d838f78065a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.082691 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6225f639-fa65-455a-938a-8d838f78065a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.083116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6225f639-fa65-455a-938a-8d838f78065a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.196828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6225f639-fa65-455a-938a-8d838f78065a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126275 May 12 14:38:39.197429 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 99/188] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:38:39 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:39.235442 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.244261 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6ecb4f81-4031-4e1a-bd8c-0ce6214510f6 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.194153 May 12 14:38:39.245204 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 90/189] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:39 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:39.528949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.529598 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.536432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.536875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.537630 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.538052 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.711297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.719914 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ae8281e4-78c6-4e50-84e3-52d035309976 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.195158 May 12 14:38:39.720757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 100/190] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:39 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:39.835361 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.836362 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.848250 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.848828 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.849620 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.850045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.008839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.017015 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b69a8b3a-4b72-4bce-bc1a-cc5ca1f36c91 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.186292 May 12 14:38:40.017618 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 91/191] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:39 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:40.066696 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:40.067835 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:40.074736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.075353 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.076592 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.076934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.239048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.247362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-97d0d2b1-432c-4d9c-bc49-cab598ba99ec tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.185296 May 12 14:38:40.247996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 101/192] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:40 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:40.262331 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:40.262937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:40.269333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.269772 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.270540 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.270967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.414354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.423332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ac157d52-d4d2-4c44-9379-b97be39a7c1b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.164929 May 12 14:38:40.424260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 92/193] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:40 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:40.549638 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-4e192e16-55ec-469a-b4f3-0212fc3bb760 req-2cca42f5-f393-4cf5-aaab-3ebb02cefd96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843e0ce-6156-4d75-9341-c049c6297133", "tag": "4e5a3761-d09e-48c6-943e-29a687c9f984"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:40.557862 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-4e192e16-55ec-469a-b4f3-0212fc3bb760 req-2cca42f5-f393-4cf5-aaab-3ebb02cefd96 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.558303 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-4e192e16-55ec-469a-b4f3-0212fc3bb760 req-2cca42f5-f393-4cf5-aaab-3ebb02cefd96 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.569520 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-4e192e16-55ec-469a-b4f3-0212fc3bb760 req-2cca42f5-f393-4cf5-aaab-3ebb02cefd96 service nova] Creating event network-changed:4e5a3761-d09e-48c6-943e-29a687c9f984 for instance f843e0ce-6156-4d75-9341-c049c6297133 on hv-cinder-84067 May 12 14:38:40.574365 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-4e192e16-55ec-469a-b4f3-0212fc3bb760 req-2cca42f5-f393-4cf5-aaab-3ebb02cefd96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028469 May 12 14:38:40.574963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 102/194] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:40.738724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:40.739656 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:40.746193 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.746792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.747841 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.748375 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.904304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.913796 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-107fab88-d7da-43fd-a850-74fad70db195 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.179778 May 12 14:38:40.914617 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 93/195] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:40 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:41.035730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:41.036740 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:41.042928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.043373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.044170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.044946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.181699 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:41.189259 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-da804de6-7ae6-4a5f-9e83-0abac1e9e875 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.158282 May 12 14:38:41.189876 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 103/196] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:41 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:41.265042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:41.265650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:41.272183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.272639 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.273403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.273839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.409986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:41.418021 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-91abae7f-a420-47d0-8e42-56b889279e5f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.157171 May 12 14:38:41.418851 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 94/197] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:41 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:41.440547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:41.441394 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:41.447501 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.448045 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.448819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.449252 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.584633 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:41.592634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8930bdc0-5b6d-4f16-9e74-0c59e7a9cfc9 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.156358 May 12 14:38:41.593205 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 104/198] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:41 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:41.932439 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:41.932967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:41.939957 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.940433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.941242 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.941673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.083284 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.091139 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e553cdc7-4ebd-46e9-bf0e-bb4f22ba91f5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1366 microversion: 2.1 time: 0.162752 May 12 14:38:42.091747 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 95/199] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:41 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:42.207586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:42.208304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:42.216171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.216783 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.217983 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.218512 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.388923 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.396976 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-dfe3c08a-8d3a-4e2c-93dd-8a86e490ca6d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.194574 May 12 14:38:42.397551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 105/200] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:42 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:42.435401 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:42.435959 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:42.442009 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.442457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.443233 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.443672 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.585644 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.593460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d192f4cb-d689-4b62-8bf2-4344f30fafa7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.161947 May 12 14:38:42.594039 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 96/201] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:42 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:42.610339 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:42.611310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:42.618022 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.618491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.619255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.619704 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.787067 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.796048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9a2cd524-7828-4282-9cc9-1f147af554d1 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.189523 May 12 14:38:42.797311 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 106/202] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:42 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:43.109187 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.109780 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.116667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.117113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.117881 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.118311 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.260455 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.267865 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ba1d314c-6ec7-4c8d-89b3-222bf40dbd27 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1556 microversion: 2.1 time: 0.162763 May 12 14:38:43.268500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 97/203] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:43.285527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-feaf86fa-50f2-4abe-9e00-8214d852144f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.285995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-feaf86fa-50f2-4abe-9e00-8214d852144f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.292519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-feaf86fa-50f2-4abe-9e00-8214d852144f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.292962 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-feaf86fa-50f2-4abe-9e00-8214d852144f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.293754 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-feaf86fa-50f2-4abe-9e00-8214d852144f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.294178 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-feaf86fa-50f2-4abe-9e00-8214d852144f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.373730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-feaf86fa-50f2-4abe-9e00-8214d852144f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092571 May 12 14:38:43.374511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 107/204] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:43.417290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.417913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.424547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.425162 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.426116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.426537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.587857 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.595896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-495360e5-f471-4df1-ae73-5f9ed6cd5712 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.185403 May 12 14:38:43.597265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 98/205] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:43.611090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.611657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.618860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.619505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.620342 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.620774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.749952 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.757839 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-736e5079-0615-41ed-91cf-069cedf6873f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.150786 May 12 14:38:43.758481 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 108/206] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:43.813253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.813959 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.820830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.821365 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.822217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.822719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.957566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.966017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-05ccaa23-1dfb-4201-9558-f109e3e02b67 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.156710 May 12 14:38:43.966608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 99/207] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:44.428562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-c154bf57-ac02-4dc8-b46b-fe0d22443d99 req-b3d72d1e-b437-4c72-a021-4f1732288615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98650df-7034-4d31-ad93-f9a133863781", "tag": "cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:44.436752 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c154bf57-ac02-4dc8-b46b-fe0d22443d99 req-b3d72d1e-b437-4c72-a021-4f1732288615 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.437185 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c154bf57-ac02-4dc8-b46b-fe0d22443d99 req-b3d72d1e-b437-4c72-a021-4f1732288615 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.448457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-c154bf57-ac02-4dc8-b46b-fe0d22443d99 req-b3d72d1e-b437-4c72-a021-4f1732288615 service nova] Creating event network-changed:cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0 for instance e98650df-7034-4d31-ad93-f9a133863781 on hv-cinder-84067 May 12 14:38:44.453501 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-c154bf57-ac02-4dc8-b46b-fe0d22443d99 req-b3d72d1e-b437-4c72-a021-4f1732288615 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028636 May 12 14:38:44.454283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 109/208] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:44.613578 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:44.614730 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:44.622450 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.623069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.624071 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.624824 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.775638 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:44.776225 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:44.783234 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.783645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.784699 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.785130 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.020178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:45.028330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4db15637-815c-44e9-8dcd-ae894b1db809 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.418600 May 12 14:38:45.037575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 100/209] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:44 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:45.037881 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:45.038005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:45.038005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:45.040596 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.041043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.041815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.042247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.044213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-80b0df73-4ee4-4e1e-bd1f-43d398013d79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.273032 May 12 14:38:45.054059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 110/210] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:44 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:45.175716 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:45.184428 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-63452576-8403-4b78-995b-0e2d3ba47254 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.154525 May 12 14:38:45.185055 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 101/211] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:45 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:46.049779 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:46.050759 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:46.057458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.057909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.058658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.059083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.061448 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:46.062410 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:46.070749 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.071196 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.072284 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.072721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.248350 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:46.256402 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-69c764e5-f802-47c5-a83f-3f667573b752 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.213560 May 12 14:38:46.258103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 111/212] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:46 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:46.260630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:46.262973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:46.263574 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:46.268717 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fa937389-a5a8-4fa8-94f8-2dca81434f41 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.211078 May 12 14:38:46.269412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 102/213] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:46 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:46.269590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.269999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.271037 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.271467 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.402644 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:46.410794 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-28b8be5c-d2c2-4e13-93f7-0866517f1a36 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.151578 May 12 14:38:46.411739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 112/214] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:46 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:47.277365 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:47.278115 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:47.287789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:47.288296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.288415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.288503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:47.289138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.289574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.295000 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.295441 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.296216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.296653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.500895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:47.504446 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:47.509032 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e179b679-375a-4c61-b60c-83cf5dbbd90a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.236614 May 12 14:38:47.509581 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 103/215] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:47 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:47.512238 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-229805fb-6883-4916-bedd-0e44890f10e8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.229182 May 12 14:38:47.512819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 113/216] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:47 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:47.514231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:47.514794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:47.521316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.521958 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.523382 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.523819 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.663527 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:47.676548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f82b69b3-10c7-4d54-ba4d-41a27b0605c0 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.165916 May 12 14:38:47.677594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 104/217] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:47 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:48.527400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:48.529480 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:48.530093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:48.530228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:48.538280 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.539197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.540078 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.540431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.540934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.541041 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.542197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.542642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.903309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:48.914943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:48.917747 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-71d65f90-bc46-4f56-9385-7c981ff95e7c tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.394012 May 12 14:38:48.918839 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 114/218] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:48 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:48.925843 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:48.926773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:48.936266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.937027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.937987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0b7e7ef7-466d-411e-a0e4-81d9cb8bbf8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.411044 May 12 14:38:48.938320 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.939050 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.939724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 105/219] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:48 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:49.085284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:49.097986 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6241a688-c369-4276-a4c2-cd206fdf9343 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1554 microversion: 2.1 time: 0.175134 May 12 14:38:49.097986 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 115/220] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:48 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:49.788897 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-a89c01fd-659d-47f1-9c95-a1a1b0080c34 req-d3136d0d-0dcb-4361-abac-52a36ebb372f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0019df15-8d39-44b1-88e4-2fa86532c89f", "name": "network-vif-deleted", "tag": "6576f263-e0eb-4c77-b47c-9fd54ff6acce"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:49.798098 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-a89c01fd-659d-47f1-9c95-a1a1b0080c34 req-d3136d0d-0dcb-4361-abac-52a36ebb372f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.798560 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-a89c01fd-659d-47f1-9c95-a1a1b0080c34 req-d3136d0d-0dcb-4361-abac-52a36ebb372f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:49.809482 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-a89c01fd-659d-47f1-9c95-a1a1b0080c34 req-d3136d0d-0dcb-4361-abac-52a36ebb372f service nova] Creating event network-vif-deleted:6576f263-e0eb-4c77-b47c-9fd54ff6acce for instance 0019df15-8d39-44b1-88e4-2fa86532c89f on hv-cinder-84067 May 12 14:38:49.814208 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-a89c01fd-659d-47f1-9c95-a1a1b0080c34 req-d3136d0d-0dcb-4361-abac-52a36ebb372f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029180 May 12 14:38:49.814816 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 106/221] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:49.935961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:49.936750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:49.943831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.944287 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:49.945064 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.945497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:49.959900 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:49.960661 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:49.968130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.968760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:49.969606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.970235 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:50.157214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:50.164102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:50.166854 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ef03465f-c3e9-4283-91e7-60d0bd96dacd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.211054 May 12 14:38:50.172981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-59a53a21-ae49-44f7-a24e-d90ce5d28f47 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.240859 May 12 14:38:50.173773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 116/222] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:49 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:50.178823 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 107/223] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:49 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:50.180163 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:50.180698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:50.187006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:50.187557 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:50.189377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:50.189816 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:50.262633 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:50.271593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2378d9dd-6a14-4c2a-a8d1-832da4f2bb4d tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1512 microversion: 2.1 time: 0.096366 May 12 14:38:50.272342 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 117/224] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:50 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:51.187396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:51.188238 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:51.192371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:51.193300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:51.197804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.198455 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.199522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.200155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.201346 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.202091 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.203111 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.203679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.393889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:51.397430 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:51.401470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c4caf162-fe0d-47ed-a3f9-8ab48c22a6dc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.214428 May 12 14:38:51.402093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 118/225] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:51 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:51.407349 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5745934c-d33a-4ba1-9b72-ae5296fd7eaa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.223476 May 12 14:38:51.407349 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 108/226] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:51 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:51.407587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:51.407875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:51.415243 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.415667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.416500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.417167 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.488384 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:51.497251 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c9d2f767-35a2-4895-a02c-bb62ecad301a tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1512 microversion: 2.1 time: 0.094120 May 12 14:38:51.498046 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 119/227] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:51 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:52.419388 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:52.420947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:52.422834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:52.423450 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:52.427512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.427988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.428762 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.429185 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.429743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.430390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.432139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.432561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.936876 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:52.946107 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e14e9fbd-9a78-4bc6-9b60-e034054db3a4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.531209 May 12 14:38:52.948403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 109/228] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:52 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:52.961812 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:52.962750 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:52.969467 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.970112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.971044 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.971628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:53.000567 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:53.010273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f3046df4-827d-4c55-8f30-4ef760f4f2a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.591543 May 12 14:38:53.010861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 120/229] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:52 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:53.064784 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f801c74ab294ea98c631aa74aed8f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c865b8a441ac423e9032a0c70301ec6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:53.074792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-64b9897c-0792-459a-bbb8-55efa73538b5 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 200 len: 1346 microversion: 2.1 time: 0.116770 May 12 14:38:53.075365 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 110/230] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:52 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 1346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:53.964772 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:53.965471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:53.972795 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:53.973280 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:53.974053 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:53.974484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.028845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:54.029924 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:54.049080 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.050504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.051487 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.051947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.180992 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:54.190312 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-657ac1e7-8ecd-4ee2-b29e-0a52c7b611fe tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.229301 May 12 14:38:54.202172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 121/231] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:53 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:54.208283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:54.209348 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:54.229505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.230943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.231906 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.233486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.253208 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:54.260946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] HTTP exception thrown: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.261741 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-34ffeeac-08c8-4d5b-9d93-5aa85705633a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.239025 May 12 14:38:54.262661 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 111/232] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:54 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Request method failure captured: May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f HTTP/1.1 May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRupNBIV_6W90CT6tOURsAqthZfGk79zmBjV64OrnccQ9yaFqv8QUF164fhZp_6HCA3W4nRgsbcxiBQ7c4_D3rdm8x6vNijFQPqw5JLTFVE-BFwRrgMgdvmj0RUOdTlgb3aKFZ4JCUV-m5T6Hwr4ZKmKaCKd66B7VvoIOe8fnWVEDh4 May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:38:54.267261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c865b8a441ac423e9032a0c70301ec6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-DeleteServersTestJSON-847106247 May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 6f801c74ab294ea98c631aa74aed8f07 May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.268670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '0019df15-8d39-44b1-88e4-2fa86532c89f'} May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:54.269393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.270457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.271471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-52e67c16-0fcb-4630-97db-4f6ace398c53 req-47ba5dfe-846e-47ac-b6ea-2daaeb1b7502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b2a6c-d508-4678-ac97-78280c88b6fa", "name": "network-vif-plugged", "status": "completed", "tag": "9a850fe2-67d9-4c71-95fe-30ee56050c6d"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:54.272517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Returning 404 to user: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:54.273774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-58d81266-39cc-442a-b2d9-cfdd33485c93 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 404 len: 111 microversion: 2.1 time: 0.070167 May 12 14:38:54.275553 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-52e67c16-0fcb-4630-97db-4f6ace398c53 req-47ba5dfe-846e-47ac-b6ea-2daaeb1b7502 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.276213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-52e67c16-0fcb-4630-97db-4f6ace398c53 req-47ba5dfe-846e-47ac-b6ea-2daaeb1b7502 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.278952 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 122/233] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:54 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:38:54.288679 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-52e67c16-0fcb-4630-97db-4f6ace398c53 req-47ba5dfe-846e-47ac-b6ea-2daaeb1b7502 service nova] Creating event network-vif-plugged:9a850fe2-67d9-4c71-95fe-30ee56050c6d for instance 801b2a6c-d508-4678-ac97-78280c88b6fa on hv-cinder-84067 May 12 14:38:54.295387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-52e67c16-0fcb-4630-97db-4f6ace398c53 req-47ba5dfe-846e-47ac-b6ea-2daaeb1b7502 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030833 May 12 14:38:54.297123 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 112/234] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:54.392486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:54.393502 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:54.400130 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.400570 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.401337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.401762 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.415777 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] HTTP exception thrown: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Request method failure captured: May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f/os-volume_attachments HTTP/1.1 May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRupNBIV_6W90CT6tOURsAqthZfGk79zmBjV64OrnccQ9yaFqv8QUF164fhZp_6HCA3W4nRgsbcxiBQ7c4_D3rdm8x6vNijFQPqw5JLTFVE-BFwRrgMgdvmj0RUOdTlgb3aKFZ4JCUV-m5T6Hwr4ZKmKaCKd66B7VvoIOe8fnWVEDh4 May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:38:54.417527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c865b8a441ac423e9032a0c70301ec6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-DeleteServersTestJSON-847106247 May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 6f801c74ab294ea98c631aa74aed8f07 May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.418990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'server_id': '0019df15-8d39-44b1-88e4-2fa86532c89f'} May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:54.420210 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:54.421490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:54.423850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Returning 404 to user: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:54.424934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9059e167-51da-43c2-9fbb-233512badd98 tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036520 May 12 14:38:54.425605 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 123/235] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:38:54 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:38:55.209784 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:55.210432 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:55.216910 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.217387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.218201 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.218626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.283307 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:55.283972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:55.290814 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.291261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.292286 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.292673 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.401051 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:55.409751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8be5fec7-88a6-43f2-9cb0-edbdfa45947b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1313 microversion: 2.1 time: 0.204914 May 12 14:38:55.411216 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 113/236] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:55 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:55.493540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:55.501584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4724dfd4-97db-41a7-baa8-2cbffbff6fcd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.222299 May 12 14:38:55.502181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 124/237] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:55 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:55.660125 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:55.661229 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:55.667721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.668283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.669101 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.669910 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.684866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] HTTP exception thrown: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Request method failure captured: May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f HTTP/1.1 May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRupNBIV_6W90CT6tOURsAqthZfGk79zmBjV64OrnccQ9yaFqv8QUF164fhZp_6HCA3W4nRgsbcxiBQ7c4_D3rdm8x6vNijFQPqw5JLTFVE-BFwRrgMgdvmj0RUOdTlgb3aKFZ4JCUV-m5T6Hwr4ZKmKaCKd66B7VvoIOe8fnWVEDh4 May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:38:55.689517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c865b8a441ac423e9032a0c70301ec6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-DeleteServersTestJSON-847106247 May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 6f801c74ab294ea98c631aa74aed8f07 May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.690987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '0019df15-8d39-44b1-88e4-2fa86532c89f'} May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:55.691775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.693007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:38:55.694342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Returning 404 to user: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:55.694342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-aae0628f-03bf-4585-88e0-624daf73c16b tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 404 len: 111 microversion: 2.1 time: 0.034908 May 12 14:38:55.694342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 114/238] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:38:55 2022] DELETE /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:38:55.699531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:55.700156 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] [instance: 0019df15-8d39-44b1-88e4-2fa86532c89f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:55.706703 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.706703 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.707492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.707961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.721310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] HTTP exception thrown: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Request method failure captured: May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f HTTP/1.1 May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRupNBIV_6W90CT6tOURsAqthZfGk79zmBjV64OrnccQ9yaFqv8QUF164fhZp_6HCA3W4nRgsbcxiBQ7c4_D3rdm8x6vNijFQPqw5JLTFVE-BFwRrgMgdvmj0RUOdTlgb3aKFZ4JCUV-m5T6Hwr4ZKmKaCKd66B7VvoIOe8fnWVEDh4 May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:38:55.722880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c865b8a441ac423e9032a0c70301ec6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c865b8a441ac423e9032a0c70301ec6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-DeleteServersTestJSON-847106247 May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: c865b8a441ac423e9032a0c70301ec6e May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-DeleteServersTestJSON-847106247 May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 6f801c74ab294ea98c631aa74aed8f07 May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-DeleteServersTestJSON-847106247-project May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.724413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '0019df15-8d39-44b1-88e4-2fa86532c89f'} May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:55.725430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. May 12 14:38:55.726828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:38:55.728250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] Returning 404 to user: Instance 0019df15-8d39-44b1-88e4-2fa86532c89f could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:55.728250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-899a9dc2-ae6b-40e0-adde-6abd03d0c3ea tempest-DeleteServersTestJSON-847106247 tempest-DeleteServersTestJSON-847106247-project] 10.222.0.79 "GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f" status: 404 len: 111 microversion: 2.1 time: 0.028673 May 12 14:38:55.728250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 125/239] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:55 2022] GET /compute/v2.1/servers/0019df15-8d39-44b1-88e4-2fa86532c89f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:38:56.427303 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:56.428265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:56.435324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.435975 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.437218 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.437798 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.519086 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:56.519774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:56.526308 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.527015 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.527966 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.528470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.704201 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:56.712686 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4fa3980c-aab8-4af1-aacf-6b178f3d6207 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1496 microversion: 2.1 time: 0.289958 May 12 14:38:56.713952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 115/240] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:56 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1496 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:56.753948 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:56.764322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-81666b15-fc45-4530-a8c0-d399458ed9f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.249025 May 12 14:38:56.764776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 126/241] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:56 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:57.449197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:57.449921 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:57.456289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.456737 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.457542 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.457971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.483860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:38:57.589846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f76434b6-eebb-444f-874c-72762bd5c878 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "DELETE /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 204 len: 0 microversion: 2.1 time: 0.144787 May 12 14:38:57.591011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 116/242] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:38:57 2022] DELETE /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:38:57.601689 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:57.602507 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:57.611199 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.611924 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.612847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.613271 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.782576 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:57.783608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:57.790673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.791395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.792446 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.793221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.991615 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:58.001963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-820f98bf-6864-4eff-9c33-932d1e147f5d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1502 microversion: 2.1 time: 0.405724 May 12 14:38:58.003065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 127/243] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:57 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:58.014002 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:58.022159 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f9d31084-2263-4975-abd5-9cb9f2c826ca tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.244106 May 12 14:38:58.022912 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 117/244] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:57 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:59.019654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:59.020332 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:59.027117 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.027635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.028655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.029060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.039395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:59.040012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:59.046982 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.047403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.048420 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.049020 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.245612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:59.250312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:59.255256 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c4da5ba1-7358-48a5-87a1-29ce75563e0e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1502 microversion: 2.1 time: 0.239657 May 12 14:38:59.256465 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 128/245] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:59 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:59.270612 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a411dc02-d5d0-4cc0-8c6c-8c91f1711cc4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.235138 May 12 14:38:59.271234 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 118/246] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:38:59 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:00.275463 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:00.276068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:00.282367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.283057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.283828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.284280 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.287680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:00.288325 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:00.295928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.296346 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.297314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.297899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.492466 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:00.500103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-110dd780-c262-42c7-a120-755080c1902e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1502 microversion: 2.1 time: 0.229174 May 12 14:39:00.501364 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 129/247] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:00 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:00.504089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:00.512318 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8153b238-5434-4eba-a192-0670cd593ed6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.228486 May 12 14:39:00.512977 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 119/248] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:00 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:01.020204 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-3f4f3920-a679-4aea-8891-93a8bcbdf7de req-75d01f5e-1dda-4223-817d-c922d69a5b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b2a6c-d508-4678-ac97-78280c88b6fa", "name": "network-vif-deleted", "tag": "9a850fe2-67d9-4c71-95fe-30ee56050c6d"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:01.030467 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-3f4f3920-a679-4aea-8891-93a8bcbdf7de req-75d01f5e-1dda-4223-817d-c922d69a5b53 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.030908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-3f4f3920-a679-4aea-8891-93a8bcbdf7de req-75d01f5e-1dda-4223-817d-c922d69a5b53 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.045332 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-3f4f3920-a679-4aea-8891-93a8bcbdf7de req-75d01f5e-1dda-4223-817d-c922d69a5b53 service nova] Creating event network-vif-deleted:9a850fe2-67d9-4c71-95fe-30ee56050c6d for instance 801b2a6c-d508-4678-ac97-78280c88b6fa on hv-cinder-84067 May 12 14:39:01.054774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-3f4f3920-a679-4aea-8891-93a8bcbdf7de req-75d01f5e-1dda-4223-817d-c922d69a5b53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038516 May 12 14:39:01.056050 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 130/249] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:01.517564 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:01.518178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:01.525207 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.525659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.526428 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.527131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.529785 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:01.530478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:01.537080 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.537700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.538730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.539225 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.561928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.562642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.563071 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lazy-loading 'fault' on Instance uuid 801b2a6c-d508-4678-ac97-78280c88b6fa {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:39:01.633497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:01.641933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ca0b8bfb-ff3b-42eb-b919-de2b5d4ade3d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 200 len: 1303 microversion: 2.1 time: 0.128704 May 12 14:39:01.642870 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 120/250] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:01 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:01.697377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:01.704800 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0578aa58-4c55-4395-9e16-8e2d8f915b72 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.179402 May 12 14:39:01.705389 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 131/251] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:01 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:02.660025 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:02.660811 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: 801b2a6c-d508-4678-ac97-78280c88b6fa] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:02.669973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.670728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:02.671679 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.672203 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:02.687136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] HTTP exception thrown: Instance 801b2a6c-d508-4678-ac97-78280c88b6fa could not be found. May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Request method failure captured: May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa HTTP/1.1 May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRvT6q22ajcIR0zUsOuOtc83Uu6oBGAUZqMg8dbuPfxP-iwSwYBI88DLCyircBUX5E4gVgWS6pXDA45g9S-J8Kh9C_kCpUrElKQV3BUj-u28Wd2jXfISlx_VWKu2Kl2pl6X61XH2PsiVjUv2f39SDFhJ2rdfNmTzZxYj9w6aQ04A7dQ May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: eeba321debcd40e6ba9eb9a5c1e534ce May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesActionsTest-656470864 May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:39:02.688936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eeba321debcd40e6ba9eb9a5c1e534ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eeba321debcd40e6ba9eb9a5c1e534ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_eeba321debcd40e6ba9eb9a5c1e534ce", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/eeba321debcd40e6ba9eb9a5c1e534ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesActionsTest-656470864 May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: eeba321debcd40e6ba9eb9a5c1e534ce May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesActionsTest-656470864 May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesActionsTest-656470864-project May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 35fc8699f921492282b5be9b5fab5b24 May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesActionsTest-656470864-project May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 801b2a6c-d508-4678-ac97-78280c88b6fa could not be found. May 12 14:39:02.690496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '801b2a6c-d508-4678-ac97-78280c88b6fa'} May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 801b2a6c-d508-4678-ac97-78280c88b6fa could not be found. May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:39:02.691514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 801b2a6c-d508-4678-ac97-78280c88b6fa could not be found. May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 801b2a6c-d508-4678-ac97-78280c88b6fa could not be found. May 12 14:39:02.692953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:02.694296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Returning 404 to user: Instance 801b2a6c-d508-4678-ac97-78280c88b6fa could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:39:02.694932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-95baa9bf-8e8e-4b22-b38f-903c6a9a2a15 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa" status: 404 len: 111 microversion: 2.1 time: 0.039085 May 12 14:39:02.698031 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 121/252] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:02 2022] GET /compute/v2.1/servers/801b2a6c-d508-4678-ac97-78280c88b6fa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:39:02.721765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:02.722377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:02.729660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.730106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:02.730883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.731316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:02.840431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1976244621", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "networks": [{"uuid": "d2bf7750-7a0c-4b6b-91bb-068ee7291c5b"}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:02.890614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:02.898481 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] validate_networks() for [('d2bf7750-7a0c-4b6b-91bb-068ee7291c5b', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:39:02.905793 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9540316e-f17b-4172-9453-31ea28db506e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.187817 May 12 14:39:02.906713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 132/253] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:02 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:03.276052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:39:03.276476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:39:03.276951 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:39:03.277359 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:39:03.277812 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:39:03.289211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:03.289709 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:03.290498 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:03.290935 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:03.309199 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Getting quotas for project eeba321debcd40e6ba9eb9a5c1e534ce. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:39:03.313367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Getting quotas for user 35fc8699f921492282b5be9b5fab5b24 and project eeba321debcd40e6ba9eb9a5c1e534ce. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:39:03.325952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:39:03.328299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:39:03.376059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-89c72af6-1bcf-4a6e-94ed-d473b221324b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545859 May 12 14:39:03.377023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 122/254] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:39:03.387236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cb25bf7a-b15d-489b-a4cd-b2c69db9151d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:03.387895 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cb25bf7a-b15d-489b-a4cd-b2c69db9151d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:03.445001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cb25bf7a-b15d-489b-a4cd-b2c69db9151d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:03.458102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cb25bf7a-b15d-489b-a4cd-b2c69db9151d tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1214 microversion: 2.1 time: 0.074620 May 12 14:39:03.458693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 133/255] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:03 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:03.924489 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:03.925077 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:03.935112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:03.937665 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:03.938478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:03.938923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.101801 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:04.114139 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a9beff64-4c90-48f0-9f0e-5413d6b9e88c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.195210 May 12 14:39:04.115023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 123/256] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:03 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:04.480191 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:04.480805 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:04.486771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:04.487221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.488027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:04.488465 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.571974 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:04.579956 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-14e2ffae-580f-4bcc-869b-269c002bdc63 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1266 microversion: 2.1 time: 0.103561 May 12 14:39:04.580543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 134/257] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:04 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:05.132615 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:05.133843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:05.140022 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.140471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.141275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.141702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:05.411543 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-dc78d767-2d78-4334-a72c-184b3f2f0e00 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.283160 May 12 14:39:05.412265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 124/258] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:05 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:05.598333 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:05.599051 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:05.609001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.609529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.610584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.611096 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.840149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:05.848138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f2dd7dd4-83f3-4a94-a26c-f53f8a8a2ceb tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.253756 May 12 14:39:05.849215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 135/259] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:05 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:06.430050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:06.431210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:06.438203 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.439179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.440181 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.440613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.560864 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-a33afd3d-55d6-4a1d-bed9-71bac89a2bbb req-5a9b721e-64bf-4685-b11a-2a3db2c72a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee23b161-0f55-47a8-8280-4d4da9d21002", "tag": "cb991b99-1797-43ce-8012-d010c35da054"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:06.570150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-a33afd3d-55d6-4a1d-bed9-71bac89a2bbb req-5a9b721e-64bf-4685-b11a-2a3db2c72a05 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.570740 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-a33afd3d-55d6-4a1d-bed9-71bac89a2bbb req-5a9b721e-64bf-4685-b11a-2a3db2c72a05 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.592584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-a33afd3d-55d6-4a1d-bed9-71bac89a2bbb req-5a9b721e-64bf-4685-b11a-2a3db2c72a05 service nova] Creating event network-changed:cb991b99-1797-43ce-8012-d010c35da054 for instance ee23b161-0f55-47a8-8280-4d4da9d21002 on hv-cinder-84067 May 12 14:39:06.606137 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-a33afd3d-55d6-4a1d-bed9-71bac89a2bbb req-5a9b721e-64bf-4685-b11a-2a3db2c72a05 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048893 May 12 14:39:06.606786 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 136/260] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:39:06.720201 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:06.733873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ed7ece6f-95d0-4ce9-959b-b69e9d7128c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.307817 May 12 14:39:06.734859 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 125/261] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:06 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:06.866324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:06.867480 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:06.875311 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.875813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.876584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.877201 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:07.221836 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:07.230169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7cfa4be4-fbdd-4265-afab-c47c04f9d053 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.369019 May 12 14:39:07.240844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 137/262] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:06 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:07.760650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:07.761345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:07.769632 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:07.769964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:07.770767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:07.771238 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:07.924863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:07.940290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f94e8a09-e86f-41de-a082-c5747c6127cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.185548 May 12 14:39:07.954182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 126/263] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:07 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:08.246793 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:08.247383 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:08.253975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.254419 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.255191 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.255897 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.391755 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:08.400265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b688c608-fca3-4e57-b015-60001b1268e2 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.157403 May 12 14:39:08.400834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 138/264] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:08 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:08.958893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:08.960871 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:08.968904 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.969436 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.970374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.970814 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:09.110028 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:09.118049 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-53798123-1acd-4f5b-bb39-31e93ac8c803 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.164252 May 12 14:39:09.118639 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 127/265] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:08 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:09.417555 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:09.418154 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:09.424863 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:09.425312 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:09.426080 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:09.426511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:09.596979 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:09.605139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-af93bacb-0493-4685-8d84-6c0f0ae0d766 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.191596 May 12 14:39:09.605730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 139/266] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:09 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:10.134746 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:10.135376 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:10.141910 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:10.148504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:10.148972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:10.149414 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:10.307130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:10.319326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-562d3034-7cbb-42cb-88bc-3bc9a5b54c26 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.188663 May 12 14:39:10.329355 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 128/267] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:10 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:10.622505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:10.623229 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:10.629266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:10.629717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:10.630492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:10.630929 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:10.866098 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:10.875224 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a3acb8dd-77f7-4b5b-8ab0-242a1628f34e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.256622 May 12 14:39:10.876291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 140/268] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:10 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:11.337125 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:11.337826 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:11.344968 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:11.345428 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:11.346699 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:11.346815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:11.481233 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:11.488759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-08e6a98e-0496-44f0-83b2-64faf43e0af2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.156095 May 12 14:39:11.489571 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 129/269] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:11 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:11.892554 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:11.893230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:11.899351 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:11.899921 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:11.900737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:11.901254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:12.037975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:12.046067 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3339e763-534f-4fcd-8e7a-44458be601f0 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.157405 May 12 14:39:12.046570 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 141/270] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:11 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:12.438270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-f03f6d32-1f64-4b40-9cb8-897e0ac4c7c9 req-aa98dcc7-9705-4e69-9da0-93b96987cb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee23b161-0f55-47a8-8280-4d4da9d21002", "name": "network-vif-plugged", "status": "completed", "tag": "cb991b99-1797-43ce-8012-d010c35da054"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:12.448726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-f03f6d32-1f64-4b40-9cb8-897e0ac4c7c9 req-aa98dcc7-9705-4e69-9da0-93b96987cb1e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:12.449370 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-f03f6d32-1f64-4b40-9cb8-897e0ac4c7c9 req-aa98dcc7-9705-4e69-9da0-93b96987cb1e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:12.464755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-f03f6d32-1f64-4b40-9cb8-897e0ac4c7c9 req-aa98dcc7-9705-4e69-9da0-93b96987cb1e service nova] Creating event network-vif-plugged:cb991b99-1797-43ce-8012-d010c35da054 for instance ee23b161-0f55-47a8-8280-4d4da9d21002 on hv-cinder-84067 May 12 14:39:12.471448 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-f03f6d32-1f64-4b40-9cb8-897e0ac4c7c9 req-aa98dcc7-9705-4e69-9da0-93b96987cb1e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038635 May 12 14:39:12.473035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 130/271] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:12.508791 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:12.509404 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:12.517776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:12.518426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:12.519315 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:12.519783 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:12.658227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:12.666154 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8de6129c-af2c-4f77-a9d2-ff59dbbac3d8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.162279 May 12 14:39:12.672398 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 142/272] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:12 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:13.063354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:13.064066 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:13.071237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:13.071724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:13.072527 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:13.072992 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:13.207492 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:13.215236 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-26e9e20e-8765-4c44-8459-9c40ffd52298 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.156022 May 12 14:39:13.216086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 131/273] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:13 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:13.684053 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:13.684759 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:13.691200 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:13.691625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:13.692512 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:13.692941 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:13.823007 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:13.831060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-eeef6c0d-0a62-48f6-93d3-16bedece6b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.151079 May 12 14:39:13.831619 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 143/274] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:13 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:14.232620 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:14.233246 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:14.240022 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:14.240464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:14.241234 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:14.241655 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:14.380925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:14.389290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-31377e80-ff64-4b62-9ffe-c933a7edaa4e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1314 microversion: 2.1 time: 0.160667 May 12 14:39:14.389860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 132/275] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:14 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:14.849587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:14.850333 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:14.857267 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:14.857713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:14.858476 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:14.858904 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:14.993907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:15.002014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e4305346-1edf-44af-a542-1202561fac0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.157070 May 12 14:39:15.002588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 144/276] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:14 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:15.407245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:15.407940 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:15.414275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.414716 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.415464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.415920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.551035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:15.559151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a836ab6d-845f-44c5-bcc2-c7cde0cd8cd3 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1497 microversion: 2.1 time: 0.155819 May 12 14:39:15.559603 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 133/277] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:15 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:16.023836 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:16.024468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:16.031221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:16.031666 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:16.032453 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:16.032877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:16.173699 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:16.181710 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7a0d1795-504a-4dfb-ba63-080330b87c1d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.164376 May 12 14:39:16.182260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 145/278] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:16 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:16.182556 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:16.183082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:16.189724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:16.190164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:16.190923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:16.191344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:16.215183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:39:16.296294 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1c2a6d46-fe53-4944-8f29-0d6e9616831a tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 204 len: 0 microversion: 2.1 time: 0.117182 May 12 14:39:16.297189 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 134/279] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:39:16 2022] DELETE /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:39:16.310318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:16.310318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:16.314403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:16.315073 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:16.315889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:16.316324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:16.455947 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:16.462117 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ed2d79c4-58c4-4da6-bbdb-a567e5ea9454 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1503 microversion: 2.1 time: 0.160353 May 12 14:39:16.462782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 146/280] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:16 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:17.204810 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:17.205935 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:17.216862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:17.217590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:17.218843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:17.219538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:17.358808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:17.366364 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-959f5a76-a581-4202-a367-fdecb63b4ada tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.168754 May 12 14:39:17.366932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 135/281] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:17 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:17.487243 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:17.487921 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:17.496529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:17.496964 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:17.497729 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:17.498157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:17.626726 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:17.634328 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-41e89cf2-4e3d-4032-9242-0667f26e71e4 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1503 microversion: 2.1 time: 0.153605 May 12 14:39:17.634929 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 147/282] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:17 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:18.384211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:18.384884 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:18.392046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:18.392515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:18.393309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:18.393753 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:18.540001 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:18.549059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a68d34dc-c9b9-45bb-b776-1d24390e86de tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.169306 May 12 14:39:18.549635 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 136/283] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:18 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:18.657113 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:18.657975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:18.667426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:18.667936 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:18.668705 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:18.669142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:18.806394 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:18.814375 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-dd2c3764-ccdd-4260-89c5-f23cde91390e tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1503 microversion: 2.1 time: 0.164470 May 12 14:39:18.814948 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 148/284] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:18 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:19.566421 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:19.567074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:19.573954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:19.574392 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:19.575180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:19.575650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:19.704845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:19.712400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fa7a15e1-4649-4644-9162-5c799cc24b21 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.149873 May 12 14:39:19.712976 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 137/285] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:19 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:19.831800 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:19.832413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:19.839123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:19.839597 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:19.840400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:19.840832 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:19.977640 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:19.985988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a1e9b699-33ab-45d0-b954-a3c783b6d7fd tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1503 microversion: 2.1 time: 0.158154 May 12 14:39:19.986563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 149/286] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:19 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:20.738621 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:20.739606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:20.750675 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:20.751415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:20.752729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:20.753442 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:20.884407 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:20.892444 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3c46283d-0f3d-4e20-a5c3-f67710e60eba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.160346 May 12 14:39:20.893017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 138/287] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:20 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:21.007673 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:21.008746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:21.015301 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.015782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:21.016538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.016975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:21.154734 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:21.162289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d3e50557-1523-4d73-9858-cae7a16fe01b tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1503 microversion: 2.1 time: 0.161124 May 12 14:39:21.162831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 150/288] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:20 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:21.914497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:21.915431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:21.922669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.923103 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:21.923911 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.924396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:22.065369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:22.076176 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c6a6fb69-e10c-436d-9e0e-5e9752c12887 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.165425 May 12 14:39:22.076912 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 139/289] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:21 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:22.184178 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:22.184982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:22.195336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:22.196123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:22.197354 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:22.197787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:22.347517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:22.356263 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fc974454-9bc3-4137-bc33-d0cb764adf20 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1503 microversion: 2.1 time: 0.178758 May 12 14:39:22.356868 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 151/290] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:22 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:23.101642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:23.102776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:23.109455 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:23.109933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:23.110707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:23.111141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:23.248531 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:23.256699 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e5df60a3-830a-48c0-b8c5-980dd4378b97 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.161798 May 12 14:39:23.257290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 140/291] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:23 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:23.374882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:23.375498 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:23.381578 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:23.382016 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:23.382773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:23.383198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:23.516757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:23.524832 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5e6fdc0d-fb61-4c88-8cf6-5018d283b9fc tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1503 microversion: 2.1 time: 0.153739 May 12 14:39:23.525500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 152/292] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:23 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:24.273116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:24.274300 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:24.281452 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:24.281891 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:24.282653 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:24.283072 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:24.481539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:24.489618 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5545ca79-3edd-4eb2-b12c-0a783418f25f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.220456 May 12 14:39:24.490220 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 141/293] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:24 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:24.542660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:24.543411 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:24.550473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:24.551020 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:24.551822 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:24.552256 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:24.651303 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fc8699f921492282b5be9b5fab5b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:24.658999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2df629c0-63d5-4cb4-86ef-04a6e061c261 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 200 len: 1461 microversion: 2.1 time: 0.120764 May 12 14:39:24.659623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 153/294] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:24 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 1461 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:24.667376 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-601266d5-0470-4896-b130-455072f3b6c2 req-ba11597e-8086-4c96-831e-e8c3783f3d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee23b161-0f55-47a8-8280-4d4da9d21002", "name": "network-vif-deleted", "tag": "cb991b99-1797-43ce-8012-d010c35da054"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:24.680367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-601266d5-0470-4896-b130-455072f3b6c2 req-ba11597e-8086-4c96-831e-e8c3783f3d26 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:24.680821 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-601266d5-0470-4896-b130-455072f3b6c2 req-ba11597e-8086-4c96-831e-e8c3783f3d26 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:24.694128 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-601266d5-0470-4896-b130-455072f3b6c2 req-ba11597e-8086-4c96-831e-e8c3783f3d26 service nova] Creating event network-vif-deleted:cb991b99-1797-43ce-8012-d010c35da054 for instance ee23b161-0f55-47a8-8280-4d4da9d21002 on hv-cinder-84067 May 12 14:39:24.701372 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-601266d5-0470-4896-b130-455072f3b6c2 req-ba11597e-8086-4c96-831e-e8c3783f3d26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 May 12 14:39:24.702125 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 142/295] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:25.506606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:25.507214 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:25.513996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:25.514454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:25.515224 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:25.515712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:25.648687 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:25.656746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-97c427b4-7e7e-447b-81bc-22b02e2b1091 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.154092 May 12 14:39:25.657317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 154/296] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:25 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:25.680742 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:25.681902 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] [instance: ee23b161-0f55-47a8-8280-4d4da9d21002] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:25.689296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:25.689746 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:25.690520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:25.690951 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:25.704784 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] HTTP exception thrown: Instance ee23b161-0f55-47a8-8280-4d4da9d21002 could not be found. May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Request method failure captured: May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 HTTP/1.1 May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRvT6q22ajcIR0zUsOuOtc83Uu6oBGAUZqMg8dbuPfxP-iwSwYBI88DLCyircBUX5E4gVgWS6pXDA45g9S-J8Kh9C_kCpUrElKQV3BUj-u28Wd2jXfISlx_VWKu2Kl2pl6X61XH2PsiVjUv2f39SDFhJ2rdfNmTzZxYj9w6aQ04A7dQ May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: eeba321debcd40e6ba9eb9a5c1e534ce May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesActionsTest-656470864 May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:39:25.706465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eeba321debcd40e6ba9eb9a5c1e534ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eeba321debcd40e6ba9eb9a5c1e534ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_eeba321debcd40e6ba9eb9a5c1e534ce", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/eeba321debcd40e6ba9eb9a5c1e534ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesActionsTest-656470864 May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: eeba321debcd40e6ba9eb9a5c1e534ce May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesActionsTest-656470864 May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesActionsTest-656470864-project May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 35fc8699f921492282b5be9b5fab5b24 May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesActionsTest-656470864-project May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance ee23b161-0f55-47a8-8280-4d4da9d21002 could not be found. May 12 14:39:25.707886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'ee23b161-0f55-47a8-8280-4d4da9d21002'} May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee23b161-0f55-47a8-8280-4d4da9d21002 could not be found. May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:39:25.708584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee23b161-0f55-47a8-8280-4d4da9d21002 could not be found. May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee23b161-0f55-47a8-8280-4d4da9d21002 could not be found. May 12 14:39:25.709786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:39:25.710788 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] Returning 404 to user: Instance ee23b161-0f55-47a8-8280-4d4da9d21002 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:39:25.710788 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-06520a4d-5882-417e-9074-b0d16c66b360 tempest-VolumesActionsTest-656470864 tempest-VolumesActionsTest-656470864-project] 10.222.0.79 "GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002" status: 404 len: 111 microversion: 2.1 time: 0.033911 May 12 14:39:25.710788 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 143/297] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:25 2022] GET /compute/v2.1/servers/ee23b161-0f55-47a8-8280-4d4da9d21002 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:39:26.674538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:26.675147 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:26.681500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:26.682698 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:26.683587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:26.684075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:26.817929 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:26.827112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5d398471-1232-4acf-becc-e1415ea24b8a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.156544 May 12 14:39:26.827828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 155/298] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:26 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:27.845061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:27.845744 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:27.852195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:27.852643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:27.853413 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:27.854567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:27.993573 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:28.001875 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-74e8ddbb-29d3-44d1-a7f7-c7693fd47c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.160769 May 12 14:39:28.002478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 144/299] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:27 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:29.019582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:29.020225 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:29.026291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:29.026725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:29.027531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:29.027977 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:29.159880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:29.167363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c1158514-bd41-4a21-8ce1-f8dba72c9a45 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.151641 May 12 14:39:29.167960 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 156/300] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:29 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:30.190164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:30.190817 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:30.198497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:30.199220 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:30.200550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:30.201265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:30.342803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:30.350762 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-66163388-dc1c-47da-acb3-5eb8d3606491 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.164805 May 12 14:39:30.351338 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 145/301] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:30 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:31.370440 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:31.371095 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:31.380641 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:31.381254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:31.382382 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:31.383001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:31.518637 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:31.528354 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-46126db9-d5f7-4e38-b8d2-1fc54f4d2dda tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.164045 May 12 14:39:31.528958 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 157/302] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:31 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:32.225083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1908654743", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "networks": [{"uuid": "2b8c7762-2c9c-4090-8f5f-a4a4caf1263c"}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:32.281117 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] validate_networks() for [('2b8c7762-2c9c-4090-8f5f-a4a4caf1263c', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:39:32.546613 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:32.547229 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:32.554041 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:32.554499 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:32.555307 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:32.555769 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:32.957524 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:32.966290 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-242568bb-7098-46ab-a77d-928e0609cda6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.424625 May 12 14:39:32.977282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 158/303] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:32 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:32.989085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:39:32.989717 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:39:32.990364 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:39:32.990763 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:39:32.991263 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:39:33.001451 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:33.001899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:33.002710 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:33.003122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:33.023475 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Getting quotas for project ec6ea995239c47df80dd8c7ff0aa23f3. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:39:33.028586 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Getting quotas for user 691afedb8d7c4ae3a69843fe6198c210 and project ec6ea995239c47df80dd8c7ff0aa23f3. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:39:33.041149 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:39:33.044899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:39:33.095906 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5f6189f7-d674-4a05-bf5d-7bb3f772ccac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877248 May 12 14:39:33.096662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 146/304] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:39:33.129486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-30e8d2e3-1e29-4398-9d45-ab69faeb612c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:33.141297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-30e8d2e3-1e29-4398-9d45-ab69faeb612c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:33.247609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-30e8d2e3-1e29-4398-9d45-ab69faeb612c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:33.257766 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-30e8d2e3-1e29-4398-9d45-ab69faeb612c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1219 microversion: 2.1 time: 0.153072 May 12 14:39:33.259337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 159/305] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:33 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:33.985364 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:33.986053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:34.001832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:34.003343 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:34.004203 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:34.004819 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:34.171158 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:34.179832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8a58ca6d-7d24-43f3-a8b6-6bcb634ee31d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.200036 May 12 14:39:34.181052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 147/306] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:33 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:34.277040 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:34.277821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:34.284504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:34.285177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:34.286146 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:34.286750 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:34.350128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:34.359278 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5d53f605-9288-4eb3-baec-98b34dc9ba2c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1223 microversion: 2.1 time: 0.085613 May 12 14:39:34.359386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 160/307] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:34 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:35.198112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:35.199891 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:35.207176 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.208005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.209431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.210090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.376797 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:35.377702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:35.378604 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:35.385461 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c3488842-1d86-432a-a67f-6408e95b9ce7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1519 microversion: 2.1 time: 0.191439 May 12 14:39:35.386062 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 148/308] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:35 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:35.386706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.387605 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.388468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.388907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.475463 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:35.483842 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-97cbc0d6-c593-4d1e-a3a0-aa86ba4ddc47 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1215 microversion: 2.1 time: 0.111820 May 12 14:39:35.484893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 161/309] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:35 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:36.406769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:36.407407 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:36.418861 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:36.419649 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:36.434276 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:36.434276 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:36.503531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:36.504198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:36.512025 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:36.512486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:36.513497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:36.513939 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:36.596375 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:36.614442 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-913b5b54-6005-44f2-9591-d38d5a2063bb tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1271 microversion: 2.1 time: 0.115992 May 12 14:39:36.615373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 162/310] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:36 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:36.624839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:36.634086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-59811938-0ab8-43f0-9909-f874dd22bb53 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1499 microversion: 2.1 time: 0.235299 May 12 14:39:36.635106 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 149/311] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:36 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1499 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:36.653232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:36.653846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:36.662531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:36.663246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:36.664073 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:36.664625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:36.864599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:36.874924 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f0c118cf-2a13-40a0-b13b-b827007d21d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1514 microversion: 2.1 time: 0.226562 May 12 14:39:36.875657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 163/312] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:36 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:37.631857 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:37.632664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:37.639187 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:37.639628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:37.640433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:37.640868 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:37.902345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:37.911537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0e888f8d-7bb2-48e6-8122-75d86d2b423c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.283407 May 12 14:39:37.924174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 150/313] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:37 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:38.564631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-88db4134-39c2-4b50-ab07-cb0a4342c3e3 req-75201f75-737c-4a0e-a59d-c1a559fd4cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ee4d94-7406-4be1-8f0a-6563ee830f97", "tag": "57c849b2-3548-4709-a6ba-435f0a47c07a"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:38.581370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-88db4134-39c2-4b50-ab07-cb0a4342c3e3 req-75201f75-737c-4a0e-a59d-c1a559fd4cc6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:38.581826 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-88db4134-39c2-4b50-ab07-cb0a4342c3e3 req-75201f75-737c-4a0e-a59d-c1a559fd4cc6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:38.594426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-88db4134-39c2-4b50-ab07-cb0a4342c3e3 req-75201f75-737c-4a0e-a59d-c1a559fd4cc6 service nova] Creating event network-changed:57c849b2-3548-4709-a6ba-435f0a47c07a for instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 on hv-cinder-84067 May 12 14:39:38.599889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-88db4134-39c2-4b50-ab07-cb0a4342c3e3 req-75201f75-737c-4a0e-a59d-c1a559fd4cc6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039777 May 12 14:39:38.600589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 164/314] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:38.929630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:38.930380 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:38.942883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:38.943738 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:38.944741 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:38.945373 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:39.147152 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:39.157013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8244c502-cc0f-49ae-b703-1cb0791e4499 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.231238 May 12 14:39:39.157922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 151/315] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:38 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:39.455117 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:39.456452 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:39.463122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:39.463572 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:39.465030 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:39.465510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:39.497146 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lazy-loading 'flavor' on Instance uuid 1fe4da68-32b7-45fc-930e-651d23fc4595 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:39:39.643156 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-69ac1e3f-5294-470b-ae4b-e3db2be859d0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595/action" status: 200 len: 32 microversion: 2.1 time: 0.192656 May 12 14:39:39.644107 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 165/316] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:39:39 2022] POST /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:39:39.653648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:39.654633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:39.672550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:39.673387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:39.674615 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:39.675111 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:39.858684 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:39.867468 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-012863f5-23fb-4b6b-b1df-2b9b211299cf tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.218385 May 12 14:39:39.868089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 152/317] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:39 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:40.178665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:40.179757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:40.188545 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:40.189209 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:40.190680 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:40.191174 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:40.346368 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:40.354738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a844b65b-8f71-44be-8d79-5948a9c344f0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.182347 May 12 14:39:40.355654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 166/318] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:40 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:40.885722 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:40.887419 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:40.902857 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:40.903493 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:40.904839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:40.905445 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:41.086844 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:41.097337 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9d8a9f83-cbc7-4ed2-8573-4a89efe48967 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.213590 May 12 14:39:41.097984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 153/319] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:40 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:41.375200 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:41.375885 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:41.383727 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:41.386335 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:41.387882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:41.388461 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:41.578014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:41.585852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c5c2dfb2-f1a2-4ea5-8eff-56860fe759f2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.216406 May 12 14:39:41.589373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 167/320] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:41 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:42.117148 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:42.118384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:42.128544 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:42.131119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:42.132160 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:42.132696 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:42.497583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:42.509616 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4b4bb8e2-5887-431b-a4b4-072431637a90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.396959 May 12 14:39:42.513626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 154/321] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:42 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:42.609958 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:42.611195 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:42.622590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:42.623242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:42.624916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:42.625935 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:43.265198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:43.277726 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-68a65aeb-9105-449f-88cf-eb5cf530c98e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.671685 May 12 14:39:43.285682 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 168/322] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:42 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:43.531630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:43.534179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:43.545844 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:43.549804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:43.550784 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:43.552096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:43.757433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:43.766296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-11712349-2e08-4d0d-b076-c08ad2c96eae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.240146 May 12 14:39:43.766854 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 155/323] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:43 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:44.303081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:44.303644 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:44.310279 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:44.311121 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:44.312228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:44.312666 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:44.451491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:44.462016 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-575df903-170e-4555-9aca-031fa7d1b1be tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.163039 May 12 14:39:44.462770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 169/324] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:44 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:44.604997 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-596822507", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:44.664149 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] validate_networks() for None {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:39:44.784805 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:44.785821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:44.813862 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:44.816864 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:44.819589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:44.820859 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.095010 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:39:45.095248 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:45.095970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:39:45.096757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:39:45.097311 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:39:45.098045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:39:45.105078 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bcc897f3-dd85-4662-83f7-1e6c5b0fc8fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.324576 May 12 14:39:45.105988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 170/325] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:44 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:45.121908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:45.122357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.123156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:45.123858 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.145950 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Getting quotas for project eb08ec33a1c8431bbe1464d11be9bfc6. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:39:45.150733 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Getting quotas for user a77a9da6c6f74aa3b9e58a1d1b84d14b and project eb08ec33a1c8431bbe1464d11be9bfc6. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:39:45.165877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:39:45.169399 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:39:45.178323 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-a18af50f-1c6b-48f4-b3ef-739573543b3a req-63378941-e468-4ab5-8e6f-2e995b319327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ee4d94-7406-4be1-8f0a-6563ee830f97", "name": "network-vif-plugged", "status": "completed", "tag": "57c849b2-3548-4709-a6ba-435f0a47c07a"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:45.198136 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-a18af50f-1c6b-48f4-b3ef-739573543b3a req-63378941-e468-4ab5-8e6f-2e995b319327 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:45.199001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-a18af50f-1c6b-48f4-b3ef-739573543b3a req-63378941-e468-4ab5-8e6f-2e995b319327 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.224664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-a18af50f-1c6b-48f4-b3ef-739573543b3a req-63378941-e468-4ab5-8e6f-2e995b319327 service nova] Creating event network-vif-plugged:57c849b2-3548-4709-a6ba-435f0a47c07a for instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 on hv-cinder-84067 May 12 14:39:45.239912 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-a18af50f-1c6b-48f4-b3ef-739573543b3a req-63378941-e468-4ab5-8e6f-2e995b319327 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068384 May 12 14:39:45.241275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 171/326] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:45.256023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3f320067-f064-4d3a-a574-0b1d74e15293 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650709 May 12 14:39:45.257641 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 156/327] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:39:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:39:45.278290 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2c12ac06-01e7-42d1-9a4e-b7a5d8ec6dfd tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:45.279016 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2c12ac06-01e7-42d1-9a4e-b7a5d8ec6dfd tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:45.378177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2c12ac06-01e7-42d1-9a4e-b7a5d8ec6dfd tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:45.385074 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2c12ac06-01e7-42d1-9a4e-b7a5d8ec6dfd tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1214 microversion: 2.1 time: 0.121543 May 12 14:39:45.389326 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 172/328] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:45 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:45.481297 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:45.482232 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:45.491896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:45.492807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.494538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:45.496476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.718606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:45.731881 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3dbe9085-eda7-4a62-8f07-c7e233009693 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.254709 May 12 14:39:45.732934 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 157/329] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:45 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:46.124186 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:46.124700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:46.131284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.131778 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.132542 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.132969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.285256 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:46.293543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ae3e4814-d6ca-4128-8736-4ca1ce969398 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.173447 May 12 14:39:46.301211 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 173/330] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:46 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:46.404028 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:46.405122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:46.412043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.412773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.413757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.414193 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.491100 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:46.510562 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e8ae14f1-fbdd-4d78-a1ae-875551c24286 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1218 microversion: 2.1 time: 0.111685 May 12 14:39:46.512109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 158/331] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:46 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:46.749770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:46.750364 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:46.758071 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.758511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.759292 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.759703 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.919423 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:46.930581 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-deb40603-6162-462c-bb7b-4ec56af0df01 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.184795 May 12 14:39:46.931464 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 174/332] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:46 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:47.315608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:47.316229 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:47.326207 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.326701 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:47.327510 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.327988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:47.491334 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:47.501361 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-db5633cd-0d22-46a7-90af-e718f6e33e78 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.190017 May 12 14:39:47.502327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 159/333] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:47 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:47.529137 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:47.530028 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:47.536503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.536984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:47.537940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.538574 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:47.607114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:47.615939 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-447cc014-1e1a-4bcf-af7e-5d4a232c4b5c tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1266 microversion: 2.1 time: 0.090871 May 12 14:39:47.627148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 175/334] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:47 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:47.950776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:47.951382 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:47.958432 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.959073 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:47.960677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.960677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:48.142396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:48.150887 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-29b9b5c9-8ca1-40d3-a1fe-7ccb5e82c5dd tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1319 microversion: 2.1 time: 0.205364 May 12 14:39:48.151954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 160/335] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:47 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:48.521021 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:48.522414 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:48.529465 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:48.529913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:48.530687 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:48.531115 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:48.647538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:48.654200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:48.660566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:48.661005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:48.661777 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:48.662199 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:48.724723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:48.735495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6fdd7019-b92b-4203-a942-289e396b1b76 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.220847 May 12 14:39:48.736470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 176/336] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:48 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:48.816589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:48.840903 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-415ebec0-0ce4-467f-bf9e-4a81135f49b5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1274 microversion: 2.1 time: 0.208909 May 12 14:39:48.850476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 161/337] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:48 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:49.174332 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:49.175152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:49.182908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.184850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.184850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.185297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.372309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:49.383830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-be08a25e-a6a2-428e-8c5a-3a13d2732f8c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1508 microversion: 2.1 time: 0.218248 May 12 14:39:49.384983 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 177/338] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:49 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:49.767850 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:49.770680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:49.788751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.792164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.793010 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.793442 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.858955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:49.859645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:49.867953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.868662 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.869707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.870405 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:50.176767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:50.180441 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:50.188321 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-252015db-6ead-4005-8c53-b9ac63db6f08 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.333449 May 12 14:39:50.188852 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-37ebd7e3-ffe0-4cc3-9c3f-33b570dd2804 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.426449 May 12 14:39:50.188997 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 178/339] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:49 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:50.199639 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 162/340] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:49 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:51.088701 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-1eddf82d-4d17-4c0b-9dc2-cdb61ec1f74f req-ff4d2356-c6db-4d57-90a0-be6223ec87d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "683433dc-ada6-43d1-accf-95c69f1ab3c6", "tag": "e8083e73-da7a-4ed8-90ea-9409de658c74"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:51.102516 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-1eddf82d-4d17-4c0b-9dc2-cdb61ec1f74f req-ff4d2356-c6db-4d57-90a0-be6223ec87d5 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:51.102962 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-1eddf82d-4d17-4c0b-9dc2-cdb61ec1f74f req-ff4d2356-c6db-4d57-90a0-be6223ec87d5 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:51.125495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-1eddf82d-4d17-4c0b-9dc2-cdb61ec1f74f req-ff4d2356-c6db-4d57-90a0-be6223ec87d5 service nova] Creating event network-changed:e8083e73-da7a-4ed8-90ea-9409de658c74 for instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 on hv-cinder-84067 May 12 14:39:51.130864 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-1eddf82d-4d17-4c0b-9dc2-cdb61ec1f74f req-ff4d2356-c6db-4d57-90a0-be6223ec87d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046445 May 12 14:39:51.131769 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 179/341] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:51.205848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:51.207203 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:51.216531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:51.217298 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:51.221938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:51.222539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:51.223391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:51.224168 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:51.224287 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:51.224805 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:51.225489 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:51.226082 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:51.539498 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:51.548610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1a327753-31c9-4912-9b90-e447a3fe3fe1 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.346491 May 12 14:39:51.549483 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 163/342] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:51 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:51.559325 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:51.566906 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3c6e5a3d-0560-4115-be45-4bda1525241a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.354774 May 12 14:39:51.567662 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 180/343] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:51 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:52.569162 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:52.569720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:52.579034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:52.579474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:52.580283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:52.580702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:52.585486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:52.586099 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:52.593065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:52.593514 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:52.594292 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:52.594727 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:52.781691 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:52.786490 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:52.791658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1b459cf3-0620-4a76-96ac-9ca620f19384 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.210021 May 12 14:39:52.792358 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 181/344] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:52 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:52.796993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-34f2a81a-ad22-4592-98d2-4bade4c8fb36 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.234297 May 12 14:39:52.797565 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 164/345] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:52 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:53.809757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:53.810643 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:53.813604 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:53.814229 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:53.817588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:53.818722 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:53.818890 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:53.819386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:53.832611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:53.833873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:53.834849 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:53.835504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:54.042881 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:54.058812 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:54.069461 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-30e343ef-3986-451e-bd6a-a15889552870 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.263407 May 12 14:39:54.072625 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-26af4897-0654-4e62-b0b5-0292741fbadb tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.263377 May 12 14:39:54.084678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 182/346] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:53 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:54.085081 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 165/347] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:53 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:55.093730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:55.094435 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:55.096888 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:55.097514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:55.102248 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:55.102705 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:55.103631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:55.105536 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:55.105862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:55.106739 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:55.107136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:55.133909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:55.444301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:55.449442 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:55.452557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-339d3ced-3141-49c6-aea0-790a5c0ab449 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.360528 May 12 14:39:55.453141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 166/348] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:55 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:55.458618 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-793da42d-1dea-4eea-982f-88e7591162c9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.369821 May 12 14:39:55.465639 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 183/349] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:55 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:56.469652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:56.474275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:56.475504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:56.476217 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:56.481419 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:56.481867 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:56.482057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:56.482485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:56.482625 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:56.483040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:56.483867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:56.484450 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:56.687396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:56.690489 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:56.695668 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f76fde04-637d-4a9a-8e7e-c780504ee886 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.229966 May 12 14:39:56.696269 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 167/350] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:56 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:56.698197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9078247a-d50e-4310-8a60-22e9a69b9f4b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.226630 May 12 14:39:56.698814 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 184/351] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:56 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:57.603760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-863eeb7c-367e-49d9-bbf0-fe35b2f823bf req-0d6802df-7f8e-4dec-8487-a11112f799ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "683433dc-ada6-43d1-accf-95c69f1ab3c6", "name": "network-vif-plugged", "status": "completed", "tag": "e8083e73-da7a-4ed8-90ea-9409de658c74"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:57.614591 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-863eeb7c-367e-49d9-bbf0-fe35b2f823bf req-0d6802df-7f8e-4dec-8487-a11112f799ab service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:57.615367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-863eeb7c-367e-49d9-bbf0-fe35b2f823bf req-0d6802df-7f8e-4dec-8487-a11112f799ab service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:57.628497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-863eeb7c-367e-49d9-bbf0-fe35b2f823bf req-0d6802df-7f8e-4dec-8487-a11112f799ab service nova] Creating event network-vif-plugged:e8083e73-da7a-4ed8-90ea-9409de658c74 for instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 on hv-cinder-84067 May 12 14:39:57.634438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-863eeb7c-367e-49d9-bbf0-fe35b2f823bf req-0d6802df-7f8e-4dec-8487-a11112f799ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 May 12 14:39:57.636054 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 168/352] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:57.715127 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:57.715818 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:57.729255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:57.730363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:57.731105 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:57.731918 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:57.732844 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:57.735406 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:57.745764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:57.748235 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:57.752126 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:57.752957 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:58.206878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:58.219267 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:58.219939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-43641fec-627c-44a0-b282-0a72b7a0f9f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.499167 May 12 14:39:58.226957 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-126211e9-cb7f-4f03-96b2-eee632818e00 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.516826 May 12 14:39:58.227925 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 185/353] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:57 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:58.231718 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 169/354] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:57 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:59.244079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:59.244782 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:59.248032 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:59.248571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:59.255485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:59.255958 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:59.256738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:59.257141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:59.258772 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:59.259233 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:59.260231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:59.260664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:59.547291 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:59.557988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-003b5477-0f4a-4efa-9168-a49fe3bf226a tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.317216 May 12 14:39:59.559070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 170/355] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:59 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:59.562528 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:59.571534 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a93df7ec-2778-4ca2-aad5-37662957fca5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.331743 May 12 14:39:59.574158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 186/356] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:39:59 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:00.577071 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:00.577838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:00.586308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:00.594026 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:00.595119 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:00.595775 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:00.597571 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:00.598355 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:00.605440 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:00.605888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:00.609401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:00.609854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:00.933220 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:00.939275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:00.943822 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8d945a4e-2d9e-43f5-87c6-45fd9bf6ffe6 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1314 microversion: 2.1 time: 0.370721 May 12 14:40:00.944447 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 171/357] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:00 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:00.957954 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3426ad71-5a06-4399-9944-ed4a5f64cd09 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.367074 May 12 14:40:00.958849 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 187/358] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:00 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:01.961237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:01.961815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:01.969474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:01.969918 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:01.970704 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:01.971133 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:01.975555 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:01.976733 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:01.982854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:01.984289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:01.985117 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:01.985704 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.191885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:02.195644 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:02.199568 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1a92d7cc-8847-4897-a29e-60249208ffa4 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1464 microversion: 2.1 time: 0.242229 May 12 14:40:02.200348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 172/359] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:01 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1464 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:02.204314 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5f92b553-eb50-4e0d-9e96-ea7b074012a4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1500 microversion: 2.1 time: 0.232543 May 12 14:40:02.204982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 188/360] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:01 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1500 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:02.221282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "454bc4ac-5d6a-4125-bce3-2bedd3b18073"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:02.222425 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:02.228438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.228881 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.229719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.230151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.250885 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:02.251765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:02.260042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] HTTP exception thrown: Cannot 'attach_volume' instance 1fe4da68-32b7-45fc-930e-651d23fc4595 while it is in vm_state rescued May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Request method failure captured: May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: POST /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595/os-volume_attachments HTTP/1.1 May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 74 May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu10Vzf4zHwjPGpyGIXEkwrnVyYUCvGapITUAbDEpSLPgnhEGxFy3O4zPcKY_jY0kkY0XRrLfpfxCJVbShjVem8DkRHlfx7b-F-meb1k0RPerFfY4ndsLpBxaiFeHCm8aKMuGOuDL-GtfRL1bZJsBQoFvU0m2_VXmQaUj6bVeLD44s May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:40:02.262119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2580eb79c9684c318adbfaa325e7f12c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 99075fda1c7d4e7698e2062407bc2433 May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {"volumeAttachment": {"volumeId": "454bc4ac-5d6a-4125-bce3-2bedd3b18073"}} May 12 14:40:02.263460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Cannot 'attach_volume' instance 1fe4da68-32b7-45fc-930e-651d23fc4595 while it is in vm_state rescued May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'server_id': '1fe4da68-32b7-45fc-930e-651d23fc4595', 'body': {'volumeAttachment': {'volumeId': '454bc4ac-5d6a-4125-bce3-2bedd3b18073'}}} May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fe4da68-32b7-45fc-930e-651d23fc4595 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:40:02.264243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1fe4da68-32b7-45fc-930e-651d23fc4595 while it is in vm_state rescued May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:02.265758 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:02.266938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:40:02.266938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:40:02.266938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1fe4da68-32b7-45fc-930e-651d23fc4595 while it is in vm_state rescued May 12 14:40:02.266938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:02.267194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.267194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.267194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.267194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.269437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Returning 409 to user: Cannot 'attach_volume' instance 1fe4da68-32b7-45fc-930e-651d23fc4595 while it is in vm_state rescued {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:40:02.270975 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-677c739e-351e-4bcb-ac05-7371cabb0699 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054240 May 12 14:40:02.276143 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 173/361] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:40:02 2022] POST /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 14:40:02.281956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-136442e3-d073-45e7-a682-be1f48eb13b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:02.282643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-136442e3-d073-45e7-a682-be1f48eb13b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:02.291055 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-136442e3-d073-45e7-a682-be1f48eb13b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.291505 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-136442e3-d073-45e7-a682-be1f48eb13b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.292442 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-136442e3-d073-45e7-a682-be1f48eb13b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.292874 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-136442e3-d073-45e7-a682-be1f48eb13b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.337593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:40:02.440419 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-136442e3-d073-45e7-a682-be1f48eb13b4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595/action" status: 202 len: 0 microversion: 2.1 time: 0.162911 May 12 14:40:02.441061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 174/362] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:40:02 2022] POST /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:40:02.453091 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:02.454103 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:02.461153 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.461596 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.462366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.475933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.500884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-51f249e5-6c3f-4042-a837-371fab8b7d7b tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 204 len: 0 microversion: 2.1 time: 0.258865 May 12 14:40:02.501824 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 189/363] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:40:02 2022] DELETE /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 14:40:02.510169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:02.511381 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:02.518729 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.519554 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.520807 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:02.521125 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:02.721018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:02.734085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3e1e5fbd-2c73-494f-921a-4a3f156656bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1508 microversion: 2.1 time: 0.287410 May 12 14:40:02.734682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 175/364] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:02 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:02.744965 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:02.769350 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d5d3c9a3-ffae-47ce-97bf-b2cb7ebe12e5 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1470 microversion: 2.1 time: 0.263323 May 12 14:40:02.770730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 190/365] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:02 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:03.752858 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:03.753422 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:03.760454 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:03.761253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:03.762081 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:03.762511 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:03.792818 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:03.794822 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:03.804967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:03.805751 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:03.807746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:03.808388 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:03.989729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:03.997552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8c3a76b4-f6b9-47f2-9bd1-6a723e4879c2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1508 microversion: 2.1 time: 0.248624 May 12 14:40:04.008457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 176/366] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:03 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:04.072838 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:04.080872 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-32097731-353a-4bb0-b651-35c599b46bb2 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1470 microversion: 2.1 time: 0.296405 May 12 14:40:04.081468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 191/367] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:03 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:05.014838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:05.015514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:05.025933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:05.026964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:05.032424 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:05.033161 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:05.100403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:05.101041 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:05.110395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:05.110972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:05.112587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:05.113106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:05.625788 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:05.635129 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:05.637979 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d54699ca-4ded-40dd-aa0c-1a5ca8157277 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1470 microversion: 2.1 time: 0.542030 May 12 14:40:05.638577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 192/368] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:05 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1470 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:05.654178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b62ddfa1-3148-4968-b783-f75414754cbc tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1508 microversion: 2.1 time: 0.643464 May 12 14:40:05.654828 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 177/369] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:05 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1508 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:05.996010 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-fdee182f-b9f7-4c02-a974-2ff65d1b9415 req-0d866a2a-e63a-49b6-865f-3578efb1a2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "683433dc-ada6-43d1-accf-95c69f1ab3c6", "name": "network-vif-deleted", "tag": "e8083e73-da7a-4ed8-90ea-9409de658c74"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:06.020621 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-fdee182f-b9f7-4c02-a974-2ff65d1b9415 req-0d866a2a-e63a-49b6-865f-3578efb1a2ce service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:06.021104 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-fdee182f-b9f7-4c02-a974-2ff65d1b9415 req-0d866a2a-e63a-49b6-865f-3578efb1a2ce service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:06.055852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-fdee182f-b9f7-4c02-a974-2ff65d1b9415 req-0d866a2a-e63a-49b6-865f-3578efb1a2ce service nova] Creating event network-vif-deleted:e8083e73-da7a-4ed8-90ea-9409de658c74 for instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 on hv-cinder-84067 May 12 14:40:06.075380 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-fdee182f-b9f7-4c02-a974-2ff65d1b9415 req-0d866a2a-e63a-49b6-865f-3578efb1a2ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077430 May 12 14:40:06.076133 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 193/370] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:06.654613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:06.655551 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:06.671848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:06.672609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:06.673316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:06.673776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:06.676163 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:06.678925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:06.683512 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:06.684068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:06.684856 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:06.685291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:06.810070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:06.829142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-80e98c7f-cb47-4a59-9767-6cfbb9e09959 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1428 microversion: 2.1 time: 0.174755 May 12 14:40:06.830464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 178/371] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:06 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1428 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:06.972448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:06.985814 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d5d2920f-e874-4839-9c15-733c07fcaff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1508 microversion: 2.1 time: 0.317555 May 12 14:40:06.987993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 194/372] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:06 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:07.846498 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:07.847835 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:07.855678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:07.856380 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:07.857227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:07.857664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:07.922416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:07.930061 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0f572749-5b95-4583-aa50-230ea1c20784 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1428 microversion: 2.1 time: 0.087443 May 12 14:40:07.930641 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 195/373] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:07 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:07.937362 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-51261769-9f5a-474a-a29a-4a78355abeb0 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Action: 'create', calling method: .version_select at 0x7f4650bdaa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1522243098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEem/esowKogp589loHf8q8q1yrw0lGEdfhdccVyOEh7x0y7q52Nh9BwAva+l9TftgtvOmT1O1ns4vLFDaZuNHI5E2SMwQELnZqtfgmSYCDDjXFH2XDFdUcos/QXeeDEw=="}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:07.951306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-51261769-9f5a-474a-a29a-4a78355abeb0 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Getting quotas for project 323bfd19e97146e39c34d3ba12370590. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:40:07.955206 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-51261769-9f5a-474a-a29a-4a78355abeb0 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Getting quotas for user 39a6607707914d03886d6c3081cc122e and project 323bfd19e97146e39c34d3ba12370590. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:40:07.978920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-51261769-9f5a-474a-a29a-4a78355abeb0 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.244927 May 12 14:40:07.979522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 179/374] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:40:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:08.002875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:08.003489 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:08.010546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:08.010973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:08.011887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:08.012374 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:08.218232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:08.229281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f49eb75d-09c2-4a4d-9679-25f78db35b28 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1508 microversion: 2.1 time: 0.230568 May 12 14:40:08.229946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 196/375] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:07 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:08.947407 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:08.948255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:08.957400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:08.957884 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:08.958673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:08.959107 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:08.994349 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:08.994913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:08.995368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lazy-loading 'fault' on Instance uuid 683433dc-ada6-43d1-accf-95c69f1ab3c6 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:09.047326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:09.054954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1b1a7599-ceba-4dfe-ac80-34f24bcf6e73 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1304 microversion: 2.1 time: 0.112259 May 12 14:40:09.055742 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 180/376] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:08 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:09.248837 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:09.249509 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:09.255984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:09.256448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:09.257799 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:09.258326 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:09.409080 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:09.416706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-439ded3b-d50e-44e6-8be3-7068047f9b4e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1508 microversion: 2.1 time: 0.173959 May 12 14:40:09.417429 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 197/377] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:09 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:10.073273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:10.073903 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:10.085606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:10.086591 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:10.087780 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:10.088410 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:10.126764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:10.127489 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:10.128059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lazy-loading 'fault' on Instance uuid 683433dc-ada6-43d1-accf-95c69f1ab3c6 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:10.185398 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a77a9da6c6f74aa3b9e58a1d1b84d14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:10.194169 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-44a79a41-f702-4da9-a244-795de25d9831 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 200 len: 1304 microversion: 2.1 time: 0.125077 May 12 14:40:10.206177 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 181/378] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:10 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:10.434465 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:10.437367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:10.446095 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:10.446540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:10.447321 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:10.447772 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:10.594903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:10.605464 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8358e662-ba40-467d-8f10-67b9a8e5394a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1514 microversion: 2.1 time: 0.174806 May 12 14:40:10.606257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 198/379] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:10 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:11.212879 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:11.213592 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] [instance: 683433dc-ada6-43d1-accf-95c69f1ab3c6] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:11.226785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:11.227341 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:11.228169 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:11.228609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:11.244009 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] HTTP exception thrown: Instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 could not be found. May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Request method failure captured: May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 HTTP/1.1 May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRwuDf77ug0IyLjmJfWMpM4A_yeExyVGIFfQFWvf_E8PJnhNp-pZN_RQ8HI_mTNYxxQYCegRZJGuGtOMKeuMBAcqRhqQ2vqxyiHAQ8bBNv8LJ_6NEG_11EkKGb0qw2VMoW_Mrenp_2CxXSmBjxQ6Tj7HOZi1bQoCkg-MQcaYT4qwcCk May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: eb08ec33a1c8431bbe1464d11be9bfc6 May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesNegativeTest-894172953 May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:40:11.245611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eb08ec33a1c8431bbe1464d11be9bfc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eb08ec33a1c8431bbe1464d11be9bfc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_eb08ec33a1c8431bbe1464d11be9bfc6", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/eb08ec33a1c8431bbe1464d11be9bfc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesNegativeTest-894172953 May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: eb08ec33a1c8431bbe1464d11be9bfc6 May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesNegativeTest-894172953 May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesNegativeTest-894172953-project May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: a77a9da6c6f74aa3b9e58a1d1b84d14b May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesNegativeTest-894172953-project May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 could not be found. May 12 14:40:11.246838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '683433dc-ada6-43d1-accf-95c69f1ab3c6'} May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 could not be found. May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:40:11.247538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 could not be found. May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 could not be found. May 12 14:40:11.252215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:40:11.253237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] Returning 404 to user: Instance 683433dc-ada6-43d1-accf-95c69f1ab3c6 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:40:11.253237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e2689e3a-c51d-4197-b5f6-d68ffafbd975 tempest-VolumesNegativeTest-894172953 tempest-VolumesNegativeTest-894172953-project] 10.222.0.79 "GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6" status: 404 len: 111 microversion: 2.1 time: 0.038288 May 12 14:40:11.253237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 182/380] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:11 2022] GET /compute/v2.1/servers/683433dc-ada6-43d1-accf-95c69f1ab3c6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:40:13.090556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-076ef1c1-2cad-4e74-9c79-e0ded1f4a9ae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'create', calling method: .version_select at 0x7f4650e74b80>, body: {"keypair": {"name": "tempest-keypair-1015039356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZJnYHOY6b6WArdvMip8rDRd24cV8dtjvw6M3cFWAnLWWoTEL8Pr+CyJhVUF5IV1jocSwQjMRomXzfrKNQXGCS+MKsTNZNQfkwHo1dl8xf25ZmCTooM1BZIULPfbQ5COw=="}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:13.109593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-076ef1c1-2cad-4e74-9c79-e0ded1f4a9ae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:40:13.116981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-076ef1c1-2cad-4e74-9c79-e0ded1f4a9ae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for user 99075fda1c7d4e7698e2062407bc2433 and project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:40:13.143864 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-076ef1c1-2cad-4e74-9c79-e0ded1f4a9ae tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064051 May 12 14:40:13.144478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 199/381] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:40:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:15.047491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1165001669", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50fb2d7f-8dca-4e62-9436-b1a9279da276"}], "security_groups": [{"name": "tempest-securitygroup--451457228"}], "key_name": "tempest-keypair-1015039356", "user_data": "}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:15.152663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] validate_networks() for [('50fb2d7f-8dca-4e62-9436-b1a9279da276', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:40:15.557403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:40:15.557830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:40:15.558302 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:40:15.558711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:40:15.559119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:40:15.568323 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:15.568770 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:15.569650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:15.570086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:15.587988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:40:15.592692 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Getting quotas for user 99075fda1c7d4e7698e2062407bc2433 and project 2580eb79c9684c318adbfaa325e7f12c. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:40:15.607785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:40:15.610870 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:40:15.649634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3c45cdd0-caeb-41e2-8e79-7b9fcc85dce0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f902d814-2e25-496c-b2c0-577171900f9d", "device": "/dev/sdb"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:15.651265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3c45cdd0-caeb-41e2-8e79-7b9fcc85dce0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:15.657586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c45cdd0-caeb-41e2-8e79-7b9fcc85dce0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:15.658024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c45cdd0-caeb-41e2-8e79-7b9fcc85dce0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:15.658847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c45cdd0-caeb-41e2-8e79-7b9fcc85dce0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:15.659352 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3c45cdd0-caeb-41e2-8e79-7b9fcc85dce0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:15.671045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f7bd18ff-c4ca-4b6c-9727-939440d1df3e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.628651 May 12 14:40:15.672152 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 183/382] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:40:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:40:15.684807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-10017a93-8a11-4993-9b5e-5704563d1792 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:15.685786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-10017a93-8a11-4993-9b5e-5704563d1792 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:15.773428 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-10017a93-8a11-4993-9b5e-5704563d1792 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:15.780908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-10017a93-8a11-4993-9b5e-5704563d1792 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1246 microversion: 2.1 time: 0.102516 May 12 14:40:15.791575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 184/383] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:15 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:16.064246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3c45cdd0-caeb-41e2-8e79-7b9fcc85dce0 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "POST /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418510 May 12 14:40:16.064901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 200/384] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:40:15 2022] POST /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:16.800350 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:16.800969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:16.806998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:16.807440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:16.808248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:16.808673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:16.875016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:16.882930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-88293582-437d-4fab-a5e1-4e9397b2444f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1298 microversion: 2.1 time: 0.088877 May 12 14:40:16.883847 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 185/385] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:16 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:17.906408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:17.907884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:17.914728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:17.915169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:17.916003 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:17.916502 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:18.135678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:18.143386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-087aa250-08b0-456c-b3f1-7d549d32b448 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.242107 May 12 14:40:18.144006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 201/386] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:17 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:18.478149 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-ebda4bd4-346e-432b-b150-be8853082590 req-d1f37b7e-9d8b-4210-a0a2-b2bb38e98821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ea7027-b13e-4308-980a-84c359ae9be3", "tag": "7c19e48a-6576-46c2-b0cc-f53674cec77e"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:18.497007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-ebda4bd4-346e-432b-b150-be8853082590 req-d1f37b7e-9d8b-4210-a0a2-b2bb38e98821 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:18.497453 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-ebda4bd4-346e-432b-b150-be8853082590 req-d1f37b7e-9d8b-4210-a0a2-b2bb38e98821 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:18.513684 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-ebda4bd4-346e-432b-b150-be8853082590 req-d1f37b7e-9d8b-4210-a0a2-b2bb38e98821 service nova] Creating event network-changed:7c19e48a-6576-46c2-b0cc-f53674cec77e for instance 38ea7027-b13e-4308-980a-84c359ae9be3 on hv-cinder-84067 May 12 14:40:18.519083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-ebda4bd4-346e-432b-b150-be8853082590 req-d1f37b7e-9d8b-4210-a0a2-b2bb38e98821 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044635 May 12 14:40:18.520417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 186/387] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:19.163132 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:19.163925 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:19.173283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:19.173829 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:19.174604 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:19.175030 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:19.323713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:19.333299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0331416e-c1ba-40b7-aa34-bbe0cf88e9cb tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.175534 May 12 14:40:19.333890 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 202/388] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:19 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:20.355252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:20.355863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:20.362298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:20.362745 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:20.363464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:20.363999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:20.505045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:20.512533 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-107420fe-a924-4caf-ac21-4d2f2512d7be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.162129 May 12 14:40:20.513113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 187/389] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:20 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:21.529794 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:21.530391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:21.537180 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:21.537668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:21.538456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:21.538878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:21.683165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:21.691047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5a909c7d-f4b8-450e-97e3-b1a894c37789 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.165244 May 12 14:40:21.691679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 203/390] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:21 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:22.710890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:22.712907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:22.719894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:22.720345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:22.721272 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:22.721706 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:22.863582 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:22.875032 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b4daf366-f476-4c27-bb71-1a1db47a6c7f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.170373 May 12 14:40:22.875818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 188/391] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:22 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:23.896445 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:23.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:23.908866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:23.909619 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:23.910894 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:23.911618 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:24.050541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:24.057987 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d6f401a5-2d5c-42ad-b20c-5d6901b23bb1 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.168095 May 12 14:40:24.058560 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 204/392] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:23 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:25.074844 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:25.075387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:25.082259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:25.082715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:25.083537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:25.084024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:25.236162 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:25.248752 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9d73b48d-2230-48f9-a045-c5d8eaaed02a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.177663 May 12 14:40:25.249600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 189/393] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:25 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:26.271047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:26.272076 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:26.283170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:26.283926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:26.285079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:26.285492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:26.417321 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:26.425497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-01003ec9-b5b4-44c3-8596-286f7a99a62f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.161053 May 12 14:40:26.426072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 205/394] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:26 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:27.446711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:27.447748 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:27.455344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:27.455816 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:27.456592 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:27.457025 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:27.593687 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:27.601132 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c1b4c2fe-fa6c-477f-8767-8818a9478be9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.161192 May 12 14:40:27.601705 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 190/395] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:27 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:28.619012 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:28.619607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:28.626695 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:28.627139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:28.627931 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:28.628358 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:28.761225 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:28.769388 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1ec61573-ae61-4452-85d5-e8cbd9012980 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.154193 May 12 14:40:28.769970 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 206/396] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:28 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:29.786634 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:29.787275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:29.794993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:29.795465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:29.796289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:29.796716 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:29.927103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-591ba13b-a891-4a36-b7fd-3f259b9deea4 req-6e5a1343-bf3c-4f06-a3ad-01a359b6a510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ea7027-b13e-4308-980a-84c359ae9be3", "name": "network-vif-plugged", "status": "completed", "tag": "7c19e48a-6576-46c2-b0cc-f53674cec77e"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:29.930082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:29.935998 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-591ba13b-a891-4a36-b7fd-3f259b9deea4 req-6e5a1343-bf3c-4f06-a3ad-01a359b6a510 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:29.936679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-591ba13b-a891-4a36-b7fd-3f259b9deea4 req-6e5a1343-bf3c-4f06-a3ad-01a359b6a510 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:29.938288 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f3615222-1698-4fee-a7ea-7a2a221a08f4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.155568 May 12 14:40:29.938967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 191/397] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:29 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:29.953417 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-591ba13b-a891-4a36-b7fd-3f259b9deea4 req-6e5a1343-bf3c-4f06-a3ad-01a359b6a510 service nova] Creating event network-vif-plugged:7c19e48a-6576-46c2-b0cc-f53674cec77e for instance 38ea7027-b13e-4308-980a-84c359ae9be3 on hv-cinder-84067 May 12 14:40:29.958336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-591ba13b-a891-4a36-b7fd-3f259b9deea4 req-6e5a1343-bf3c-4f06-a3ad-01a359b6a510 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034972 May 12 14:40:29.958931 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 207/398] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:40:30.960942 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:30.961837 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:30.970673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:30.971118 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:30.971924 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:30.972357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:31.101730 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:31.110592 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f490b2f2-6e95-47cd-a3b6-882a7d6a4e5d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.156296 May 12 14:40:31.111136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 192/399] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:30 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:32.137949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:32.139149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:32.149758 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:32.150483 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:32.151756 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:32.152485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:32.300732 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:32.308813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2adb495e-addd-4bd3-a95c-ebcf450e4735 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.178729 May 12 14:40:32.309412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 208/400] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:32 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:33.328702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:33.329292 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:33.336959 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:33.337409 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:33.338190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:33.338628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:33.477213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:33.486862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-cd38fead-eab5-48e1-8c51-6e6a45f3a84c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.163824 May 12 14:40:33.487446 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 193/401] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:33 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:34.508976 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:34.509868 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:34.520910 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:34.521664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:34.522937 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:34.523626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:34.659405 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:34.667237 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bfb8bc2e-9b05-4d99-b973-9c78c30dd451 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.165006 May 12 14:40:34.667851 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 209/402] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:34 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:35.689803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:35.690760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:35.701945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:35.702799 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:35.703580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:35.704052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:35.844861 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:35.852652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-27b5f756-37d5-4d01-8f4a-582216526507 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.170471 May 12 14:40:35.853201 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 194/403] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:35 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:36.869972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:36.870587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:36.877537 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:36.877989 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:36.878761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:36.879198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:37.010103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:37.017926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bd1c41ad-ea23-42c6-9109-0575138c1dd9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.151724 May 12 14:40:37.018347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 210/404] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:36 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:38.037782 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:38.038841 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:38.049657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.050250 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.051411 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.052000 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.200641 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:38.212541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1cd8f1ef-ef30-45c7-afc1-518ee10829ba tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.180712 May 12 14:40:38.213334 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 195/405] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:38 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:39.231870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:39.232611 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:39.238929 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:39.239378 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:39.240190 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:39.240617 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:39.391701 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:39.399500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-dbf78eb7-4240-4904-a192-b6a4d7f78ea9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.171948 May 12 14:40:39.400131 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 211/406] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:39 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:40.421869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:40.423553 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:40.433719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.434349 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.435634 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.436665 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.584514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:40.592764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e1c3c675-4563-4e13-b593-6a3d047f8886 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.178025 May 12 14:40:40.593346 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 196/407] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:40 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:41.618736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:41.619664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:41.630799 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:41.631546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:41.632865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:41.633584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:41.769551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:41.777416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-168fef7b-c5dd-4d57-bb4e-9a73a41ca3bd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.165342 May 12 14:40:41.778031 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 212/408] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:41 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:42.798083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:42.799003 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:42.810636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:42.811308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:42.812512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:42.812981 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:42.942598 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:42.950728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5b0101c3-4933-4a66-8932-112d20a06fde tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.159168 May 12 14:40:42.951269 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 197/409] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:42 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:43.970712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:43.971344 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:43.980789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:43.981320 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:43.982228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:43.982747 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:44.117689 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:44.127419 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cc2ad23a-426a-4996-8717-fcca96d1aa63 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.162812 May 12 14:40:44.128025 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 213/410] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:43 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:45.145116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:45.145761 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:45.152480 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.152922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:45.153672 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.154143 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:45.361961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:45.370067 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-aa450ce0-a383-4b68-be2a-c0ccead45562 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.228943 May 12 14:40:45.370636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 198/411] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:45 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:46.387412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:46.388067 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:46.396072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:46.396605 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.397725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:46.398333 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.536857 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:46.546252 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4d4b6c2a-1a1d-4d70-9664-c657f43e5d23 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1371 microversion: 2.1 time: 0.162610 May 12 14:40:46.546854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 214/412] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:46 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:47.563889 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:47.564454 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:47.575140 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:47.575424 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:47.576208 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:47.577232 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:47.708034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:47.715480 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c6d1c651-d4d0-40a4-98c2-314132b399be tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1565 microversion: 2.1 time: 0.155790 May 12 14:40:47.716078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 199/413] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:47 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:47.732197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-95faeafc-6e3e-49c1-9bcc-20761197a672 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:47.732743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-95faeafc-6e3e-49c1-9bcc-20761197a672 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:47.740020 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95faeafc-6e3e-49c1-9bcc-20761197a672 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:47.740477 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95faeafc-6e3e-49c1-9bcc-20761197a672 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:47.741246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95faeafc-6e3e-49c1-9bcc-20761197a672 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:47.741679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95faeafc-6e3e-49c1-9bcc-20761197a672 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:48.046694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-95faeafc-6e3e-49c1-9bcc-20761197a672 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.318480 May 12 14:40:48.047275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 215/414] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:40:47 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-interface => generated 285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:49.053928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-d17f0e3e-4e65-48da-a477-0412dfc67965 req-aa25f0b2-6d45-4869-ae40-44f4b5bb51e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ea7027-b13e-4308-980a-84c359ae9be3", "tag": "7c19e48a-6576-46c2-b0cc-f53674cec77e"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:49.062601 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d17f0e3e-4e65-48da-a477-0412dfc67965 req-aa25f0b2-6d45-4869-ae40-44f4b5bb51e6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.063138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d17f0e3e-4e65-48da-a477-0412dfc67965 req-aa25f0b2-6d45-4869-ae40-44f4b5bb51e6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.074505 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-d17f0e3e-4e65-48da-a477-0412dfc67965 req-aa25f0b2-6d45-4869-ae40-44f4b5bb51e6 service nova] Creating event network-changed:7c19e48a-6576-46c2-b0cc-f53674cec77e for instance 38ea7027-b13e-4308-980a-84c359ae9be3 on hv-cinder-84067 May 12 14:40:49.079624 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-d17f0e3e-4e65-48da-a477-0412dfc67965 req-aa25f0b2-6d45-4869-ae40-44f4b5bb51e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029487 May 12 14:40:49.080398 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 200/415] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:49.134888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:49.135487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:49.153131 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.153581 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.158920 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.160855 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.303539 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lazy-loading 'services' on Instance uuid a0ee4d94-7406-4be1-8f0a-6563ee830f97 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:49.428190 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e0d249fc-6cb1-4ffc-a082-d7ebfe0fdc69 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97/os-volume_attachments/f902d814-2e25-496c-b2c0-577171900f9d" status: 202 len: 0 microversion: 2.1 time: 0.298969 May 12 14:40:49.432170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 216/416] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:40:49 2022] DELETE /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97/os-volume_attachments/f902d814-2e25-496c-b2c0-577171900f9d => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:40:49.726206 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1438551730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1522243098", "security_groups": [{"name": "tempest-secgroup-smoke-1806353389"}], "networks": [{"uuid": "a49560f3-0c8f-4242-9059-9a790b48facb"}], "block_device_mapping_v2": [{"uuid": "15d47b56-9fed-4e14-a183-b222e829bbd5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:49.839704 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] validate_networks() for [('a49560f3-0c8f-4242-9059-9a790b48facb', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:40:50.299820 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:40:50.305594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:40:50.306293 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:40:50.306860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:40:50.307288 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:40:50.321600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:50.324732 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:50.325934 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:50.326651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:50.343834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Getting quotas for project 323bfd19e97146e39c34d3ba12370590. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:40:50.347767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Getting quotas for user 39a6607707914d03886d6c3081cc122e and project 323bfd19e97146e39c34d3ba12370590. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:40:50.404374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:40:50.406895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15d47b56-9fed-4e14-a183-b222e829bbd5',volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:40:50.545306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d0e28551-a814-4c78-8fe3-7a524b55bff6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.823406 May 12 14:40:50.545952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 201/417] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:40:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:40:50.557677 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f1e5e33a-a0f5-46a0-a50a-f46f79d8d62d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:50.558392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f1e5e33a-a0f5-46a0-a50a-f46f79d8d62d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:50.622995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f1e5e33a-a0f5-46a0-a50a-f46f79d8d62d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:50.630054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f1e5e33a-a0f5-46a0-a50a-f46f79d8d62d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1089 microversion: 2.1 time: 0.076352 May 12 14:40:50.630654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 217/418] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:50 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:51.629090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:51.629659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:51.636179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.636838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.637606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.638039 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.646340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:51.647054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:51.654333 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.654775 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.655667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.656290 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.666907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:40:51.734713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:51.746023 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-66d6c282-5836-434c-9a21-ec09dbbe1213 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1195 microversion: 2.1 time: 0.103434 May 12 14:40:51.748492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 218/419] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:51 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1195 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:51.760669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9dcada67-aa28-4ee8-a5e1-63106a61d737 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 204 len: 0 microversion: 2.1 time: 0.135577 May 12 14:40:51.762437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 202/420] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:40:51 2022] DELETE /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:40:51.771803 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:51.772740 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:51.779011 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.779546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.780461 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.781041 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.934818 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:51.942848 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5662d2d1-ba7f-4278-93b1-2b7efcadd90c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1514 microversion: 2.1 time: 0.175761 May 12 14:40:51.943468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 219/421] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:51 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:52.768718 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:52.769271 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:52.775948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.776391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.777145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.777535 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.844792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:52.855885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4b86a094-df1d-4a79-8a7a-10ae36f5625b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1205 microversion: 2.1 time: 0.092200 May 12 14:40:52.856651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 203/422] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:52 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:52.964335 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:52.965367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:52.976797 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.977535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.978856 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.979588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:53.114347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:53.122976 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-772f4f77-ca92-41a3-820e-f73ca4cb6eef tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1514 microversion: 2.1 time: 0.165062 May 12 14:40:53.123552 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 220/423] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:52 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:53.873514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:53.874078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:53.881197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:53.881647 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:53.882422 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:53.882856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:53.966600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:53.974981 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-57cc3b9d-f74a-4d7f-9d29-f838b3c557f3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1205 microversion: 2.1 time: 0.105403 May 12 14:40:53.975526 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 204/424] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:53 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:54.142171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:54.142993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:54.150448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.151164 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.151971 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.152412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.440874 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:54.449620 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0e420103-2c0d-4785-a50f-8f3f1a26fe9b tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1514 microversion: 2.1 time: 0.312381 May 12 14:40:54.462558 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 221/425] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:54 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:54.993265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:54.994213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:55.001614 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.002075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.003325 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.004030 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.183865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-fd0fcb74-15fb-4a94-9f44-9257df6d5a07 req-df20b7e8-6ac1-4767-bca7-5bf80dae3603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ee4d94-7406-4be1-8f0a-6563ee830f97", "name": "network-vif-deleted", "tag": "57c849b2-3548-4709-a6ba-435f0a47c07a"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:55.202928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-fd0fcb74-15fb-4a94-9f44-9257df6d5a07 req-df20b7e8-6ac1-4767-bca7-5bf80dae3603 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.205304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-fd0fcb74-15fb-4a94-9f44-9257df6d5a07 req-df20b7e8-6ac1-4767-bca7-5bf80dae3603 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.218899 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-fd0fcb74-15fb-4a94-9f44-9257df6d5a07 req-df20b7e8-6ac1-4767-bca7-5bf80dae3603 service nova] Creating event network-vif-deleted:57c849b2-3548-4709-a6ba-435f0a47c07a for instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 on hv-cinder-84067 May 12 14:40:55.224372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-fd0fcb74-15fb-4a94-9f44-9257df6d5a07 req-df20b7e8-6ac1-4767-bca7-5bf80dae3603 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044950 May 12 14:40:55.224966 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 222/426] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:55.291294 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:55.303019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-978f25d0-7b22-4a1a-9ddf-7f0f5d8901ec tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.314162 May 12 14:40:55.314200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 205/427] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:54 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:55.467329 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:55.468671 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:55.476269 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.476983 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.478238 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.479164 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.521920 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.522367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.522828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lazy-loading 'fault' on Instance uuid a0ee4d94-7406-4be1-8f0a-6563ee830f97 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:55.582216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:55.589923 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-14ab0c1e-89a7-44ca-9cda-586bbe195c79 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 200 len: 1309 microversion: 2.1 time: 0.126939 May 12 14:40:55.590514 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 223/428] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:55 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:56.322344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:56.322970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:56.332757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.333327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.334457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.334952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.475473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:56.486492 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-92524d5e-d609-405d-883a-59f7ad3145a9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.169961 May 12 14:40:56.487056 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 206/429] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:56 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:56.609826 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:56.610432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: a0ee4d94-7406-4be1-8f0a-6563ee830f97] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:56.617340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.617801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.618566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.619026 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.634627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] HTTP exception thrown: Instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 could not be found. May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Request method failure captured: May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 HTTP/1.1 May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRwgaF6DDpzVuLISmIAUTyRiWU_xLJ8KT97MuCafll_8b3w4RfQ_4XfErlpm2QTWEsACQmMAu6eZnHekFgDNBtLP7umV1ttNYWKlUndeB59GRlZdsUWXGCRfEADVxMRe8vs4EB4iVp6DkQNb2aGshx0gE2OfwRQb2Yvi-6MphDXkhDU May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: ec6ea995239c47df80dd8c7ff0aa23f3 May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1023559131 May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:40:56.636296 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec6ea995239c47df80dd8c7ff0aa23f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec6ea995239c47df80dd8c7ff0aa23f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec6ea995239c47df80dd8c7ff0aa23f3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec6ea995239c47df80dd8c7ff0aa23f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesSnapshotTestJSON-1023559131 May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: ec6ea995239c47df80dd8c7ff0aa23f3 May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1023559131 May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesSnapshotTestJSON-1023559131-project May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 691afedb8d7c4ae3a69843fe6198c210 May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesSnapshotTestJSON-1023559131-project May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 could not be found. May 12 14:40:56.637801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'a0ee4d94-7406-4be1-8f0a-6563ee830f97'} May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 could not be found. May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:40:56.638679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 could not be found. May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 could not be found. May 12 14:40:56.640506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:40:56.641878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Returning 404 to user: Instance a0ee4d94-7406-4be1-8f0a-6563ee830f97 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:40:56.641878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c1486fc0-bc8f-4edf-b5e1-2e900e1fe092 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97" status: 404 len: 111 microversion: 2.1 time: 0.033678 May 12 14:40:56.641878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 224/430] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:56 2022] GET /compute/v2.1/servers/a0ee4d94-7406-4be1-8f0a-6563ee830f97 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:40:57.242394 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-1d219f57-57a6-4a9a-8fe5-72b802ef3629 req-9010a26f-460b-4d90-9a06-f36edfa56b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9198b32a-74d2-4298-bed5-be716180d682", "tag": "5e60855e-b1bf-4dc0-8a72-5c0e800298c2"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:57.255661 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-1d219f57-57a6-4a9a-8fe5-72b802ef3629 req-9010a26f-460b-4d90-9a06-f36edfa56b5f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.256326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-1d219f57-57a6-4a9a-8fe5-72b802ef3629 req-9010a26f-460b-4d90-9a06-f36edfa56b5f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.270669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-1d219f57-57a6-4a9a-8fe5-72b802ef3629 req-9010a26f-460b-4d90-9a06-f36edfa56b5f service nova] Creating event network-changed:5e60855e-b1bf-4dc0-8a72-5c0e800298c2 for instance 9198b32a-74d2-4298-bed5-be716180d682 on hv-cinder-84067 May 12 14:40:57.275704 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-1d219f57-57a6-4a9a-8fe5-72b802ef3629 req-9010a26f-460b-4d90-9a06-f36edfa56b5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037401 May 12 14:40:57.276291 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 207/431] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:57.509514 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:57.510397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:57.518646 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.519100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.519918 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.520353 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.666385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:57.678187 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e59723d1-d657-4d30-8048-0bd23b230456 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.175229 May 12 14:40:57.678938 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 225/432] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:57 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:58.700622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:58.701582 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:58.708599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.709049 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.709827 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.710260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.857187 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:58.865138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-720a2ff6-5239-4cf2-b6d8-4c31b497abde tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.171967 May 12 14:40:58.865677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 208/433] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:58 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:59.885467 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:59.886387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:59.897282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.897969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:59.899142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.899844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:00.049859 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:00.061540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-59e22126-065d-4cf4-85d2-4e65c3826530 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.181833 May 12 14:41:00.062476 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 226/434] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:40:59 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:01.079440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:01.080007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:01.086972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.087799 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.088797 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.089536 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.540593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:01.549166 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-02d5f896-f5c4-460e-a46a-0ac9a6b09b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.474072 May 12 14:41:01.549779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 209/435] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:01 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:02.567117 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:02.568007 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:02.575358 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:02.575831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:02.576649 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:02.577070 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:02.723666 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:02.731110 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0c95eaff-b35c-4d05-8c91-39c08ff7550d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.168391 May 12 14:41:02.731664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 227/436] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:02 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:03.752305 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:03.752927 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:03.760001 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.760457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.761229 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.761666 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.903595 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:03.912981 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-de4c3bdf-6d44-4abf-aca6-b6c8fd077095 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.166845 May 12 14:41:03.913569 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 210/437] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:03 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:04.623727 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-08ca90bd-8676-4ccb-b1c3-dc9991ab3cfa tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:04.624586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-08ca90bd-8676-4ccb-b1c3-dc9991ab3cfa tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:04.631603 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08ca90bd-8676-4ccb-b1c3-dc9991ab3cfa tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.632123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08ca90bd-8676-4ccb-b1c3-dc9991ab3cfa tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.632893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08ca90bd-8676-4ccb-b1c3-dc9991ab3cfa tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.633328 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08ca90bd-8676-4ccb-b1c3-dc9991ab3cfa tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.656409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-08ca90bd-8676-4ccb-b1c3-dc9991ab3cfa tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/ips" status: 200 len: 152 microversion: 2.20 time: 0.039264 May 12 14:41:04.656917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 228/438] 10.222.0.79 () {60 vars in 1288 bytes} [Thu May 12 14:41:04 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:41:04.930458 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:04.931124 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:04.938912 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.939678 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.940524 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.941177 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:05.075929 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:05.083677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-80515cb9-0eb4-4ec2-ad83-46fbc8f5dfab tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.157171 May 12 14:41:05.084260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 211/439] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:04 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:06.101337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:06.101991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:06.108986 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:06.109623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:06.110494 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:06.110951 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:06.252242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:06.260106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5b497624-b9a1-4142-9097-ae699ec9fcce tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.162880 May 12 14:41:06.260677 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 229/440] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:06 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:07.282197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:07.283118 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:07.294324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:07.295070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:07.296395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:07.297127 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:07.434504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:07.444198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fbd2e040-eb8e-4465-8f16-1e57279f980d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.169044 May 12 14:41:07.444780 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 212/441] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:07 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:08.473184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:08.473810 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:08.480821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.481273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:08.482040 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.482471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:08.626201 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:08.633784 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3d6b6981-1b70-4d97-8caf-f699fa815a4c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.164747 May 12 14:41:08.634515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 230/442] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:08 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:08.644773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-221078625", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "networks": [{"uuid": "2b8c7762-2c9c-4090-8f5f-a4a4caf1263c"}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:08.700372 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] validate_networks() for [('2b8c7762-2c9c-4090-8f5f-a4a4caf1263c', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:41:09.063437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:41:09.064000 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:41:09.064474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:41:09.064880 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:41:09.065291 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:41:09.074807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.075247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.076087 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.076518 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.093543 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Getting quotas for project ec6ea995239c47df80dd8c7ff0aa23f3. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:41:09.097584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Getting quotas for user 691afedb8d7c4ae3a69843fe6198c210 and project ec6ea995239c47df80dd8c7ff0aa23f3. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:41:09.108938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:41:09.111259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:41:09.155742 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8e1101bc-98b4-449e-8045-a707a24695e5 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515234 May 12 14:41:09.156408 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 213/443] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:41:09.166411 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c55364ae-570c-4a0c-bbb0-54ccd5718804 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:09.167022 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c55364ae-570c-4a0c-bbb0-54ccd5718804 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:09.223785 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c55364ae-570c-4a0c-bbb0-54ccd5718804 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:09.230436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c55364ae-570c-4a0c-bbb0-54ccd5718804 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1218 microversion: 2.1 time: 0.067858 May 12 14:41:09.231018 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 231/444] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:09 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:09.650228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:09.650815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:09.658006 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.658463 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.659243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.659670 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.712421 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:09.713026 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:09.719668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.720167 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.720947 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.721396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.747006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'flavor' on Instance uuid 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:41:09.797567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:09.806688 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f31fb607-d92b-419a-9583-5eba920faf33 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.160146 May 12 14:41:09.816709 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 214/445] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:09 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:10.026505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-01ce5344-77ce-4753-aa82-9ac47ff1c729 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/action" status: 202 len: 0 microversion: 2.20 time: 0.317801 May 12 14:41:10.027138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 232/446] 10.222.0.79 () {62 vars in 1318 bytes} [Thu May 12 14:41:09 2022] POST /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:41:10.035539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:10.036194 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:10.042445 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.042910 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.044104 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.044529 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.191987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:10.200143 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:10.202065 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:10.203085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-950a6209-3e40-46c6-a436-0cdf804d5b48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.171458 May 12 14:41:10.205754 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 215/447] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:10 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:10.248654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:10.249376 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:10.255881 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.256372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.257159 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.257581 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.330663 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:10.338678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fffb8c29-daaf-4b2f-86fb-7ff2d2d212f7 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1278 microversion: 2.1 time: 0.094419 May 12 14:41:10.339279 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 233/448] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:10 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:10.826145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:10.826767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:10.834866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.835259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.836299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.836736 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.046652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.055525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-68ed476a-1888-4521-a1b6-547ab34cbaac tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.235780 May 12 14:41:11.056417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 216/449] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:10 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:11.222486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:11.223147 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:11.230297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.230814 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.231675 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.232336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.356404 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:11.357140 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:11.365449 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.366063 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.367124 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.368666 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.485100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.493830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.495462 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.496708 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-49c76cbb-91f2-4617-9ec5-21478e4b46da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.278673 May 12 14:41:11.497627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 234/450] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:11 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:11.630133 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.638101 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4dbb9928-2d29-4a4a-aec4-17b4d5f603bc tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.286505 May 12 14:41:11.638686 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 217/451] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:11 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:12.045718 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-6ae8e106-cdc0-417b-854a-c86015df49ca req-0fdd791e-9de3-4a25-8684-eb5ee1624ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e248f403-7a65-42e2-a6b4-1f6c347a2e2e", "tag": "2c2c830c-addb-4ce9-8ac8-ee700f599af2"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:12.055909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-6ae8e106-cdc0-417b-854a-c86015df49ca req-0fdd791e-9de3-4a25-8684-eb5ee1624ca1 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.056518 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-6ae8e106-cdc0-417b-854a-c86015df49ca req-0fdd791e-9de3-4a25-8684-eb5ee1624ca1 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.072577 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:12.073213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:12.079413 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.079880 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.080647 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.081073 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.086327 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-6ae8e106-cdc0-417b-854a-c86015df49ca req-0fdd791e-9de3-4a25-8684-eb5ee1624ca1 service nova] Creating event network-changed:2c2c830c-addb-4ce9-8ac8-ee700f599af2 for instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e on hv-cinder-84067 May 12 14:41:12.095255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-6ae8e106-cdc0-417b-854a-c86015df49ca req-0fdd791e-9de3-4a25-8684-eb5ee1624ca1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052572 May 12 14:41:12.095255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 235/452] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:12.286648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.295326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b2a88412-e64f-4773-bc9a-5eb9e9c3cc1d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.226348 May 12 14:41:12.296199 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 218/453] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:12 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:12.517413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:12.518136 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:12.524517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.524968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.525744 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.526179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.654673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:12.655386 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:12.661973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.662429 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.663200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.663728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.674314 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.683552 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.685085 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.686270 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8fb8a5fc-2ddd-4e3a-b1f0-c01aaabf8d2c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.174440 May 12 14:41:12.687041 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 236/454] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:12 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:12.792853 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.802644 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-cad08697-13e2-4cfa-91b4-a1b2fca435ff tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.151671 May 12 14:41:12.803814 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 219/455] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:12 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:13.317664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:13.318703 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:13.329118 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.329861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.331122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.331875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.478969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.487299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f65da72a-9c24-45c1-bd58-3dd09341522b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.176269 May 12 14:41:13.487910 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 237/456] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:13 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:13.709284 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:13.710283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:13.721579 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.722308 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.723587 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.724358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.820765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:13.821400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:13.828345 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.828860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.829786 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.830306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.866915 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.874974 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.876560 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.877937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6383531a-a326-4e89-8670-3875302a43b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.175335 May 12 14:41:13.878511 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 220/457] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:13 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:13.967873 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.975274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-aa6b1887-bb68-4895-b8cb-d6972e5bd689 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.158423 May 12 14:41:13.975868 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 238/458] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:13 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:14.474318 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-166da071-2049-46ce-bd75-cb039ecd9729 req-0cb9ac0d-590a-43c4-ace4-db0bdc14f517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9198b32a-74d2-4298-bed5-be716180d682", "name": "network-vif-plugged", "status": "completed", "tag": "5e60855e-b1bf-4dc0-8a72-5c0e800298c2"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:14.482724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-166da071-2049-46ce-bd75-cb039ecd9729 req-0cb9ac0d-590a-43c4-ace4-db0bdc14f517 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.483053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-166da071-2049-46ce-bd75-cb039ecd9729 req-0cb9ac0d-590a-43c4-ace4-db0bdc14f517 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.495254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-166da071-2049-46ce-bd75-cb039ecd9729 req-0cb9ac0d-590a-43c4-ace4-db0bdc14f517 service nova] Creating event network-vif-plugged:5e60855e-b1bf-4dc0-8a72-5c0e800298c2 for instance 9198b32a-74d2-4298-bed5-be716180d682 on hv-cinder-84067 May 12 14:41:14.500379 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-166da071-2049-46ce-bd75-cb039ecd9729 req-0cb9ac0d-590a-43c4-ace4-db0bdc14f517 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029782 May 12 14:41:14.500980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 221/459] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:14.503519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:14.504145 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:14.510231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.510691 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.511449 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.511904 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.652639 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:14.660887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f06b3bbb-1eb2-4590-91d3-52da9fb96a4b tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.161407 May 12 14:41:14.661462 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 239/460] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:14 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:14.903459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:14.904652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:14.913316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.913759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.914554 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.914985 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.996253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:14.997079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:15.003661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.004299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.005075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.005509 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.055304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.063339 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.065719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.066887 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-503673b5-c047-4e20-8279-b902ee3f9038 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.171834 May 12 14:41:15.067489 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 222/461] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:14 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:15.148366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.160310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4a7d3677-8d80-49ee-890e-c6fd85bffed2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.167589 May 12 14:41:15.161112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 240/462] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:14 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:15.682509 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:15.683521 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:15.692848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.693293 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.694064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.694500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.847630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.855506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-395723f3-85f2-4f37-98d8-7f4e8dfa4e92 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.179556 May 12 14:41:15.856109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 223/463] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:15 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:16.089363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:16.090340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:16.099622 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.100302 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.101328 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.101907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.179524 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:16.180163 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:16.187132 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.187579 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.188381 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.188808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.268243 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.277095 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.278616 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.279819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6901c57b-bd41-42f3-9235-93813fed90fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.196602 May 12 14:41:16.280786 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 241/464] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:16 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:16.334320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.342027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1861c4ea-8d96-4adb-b04f-e338612fe280 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.167130 May 12 14:41:16.342532 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 224/465] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:16 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:16.873320 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:16.873959 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:16.880759 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.881235 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.882293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.882723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.074055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.086045 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d0c7fac2-189f-428c-8c6d-db3e9d2e65ea tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.216385 May 12 14:41:17.086689 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 242/466] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:16 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:17.298952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:17.299566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:17.306782 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.307228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.308036 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.308471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.318379 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:41:17.318955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 14:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:41:17.359414 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:17.360044 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:17.367527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.368003 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.368760 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.369194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.478131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.486711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.488866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.490003 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1eccec86-ca55-4d20-bf39-fe0aa7517f44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.195110 May 12 14:41:17.490846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 225/467] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:17 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:17.523849 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.535744 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-38409d47-2cf5-433d-8793-329bdda82e99 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.179991 May 12 14:41:17.536610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 243/468] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:17 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:18.110438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:18.111218 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:18.118761 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.119201 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.119984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.120411 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.262518 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.270780 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b963c180-beb6-4b45-9d56-bb3b4080197a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.166500 May 12 14:41:18.271366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 226/469] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:18 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:18.512668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:18.513656 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:18.524634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.525361 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.526603 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.527315 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.557767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:18.558379 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:18.565505 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.565883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.566726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.567155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.735572 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.744920 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.746148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.747326 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-491fb98d-e5fc-4d41-8034-11f6efe993cd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.241163 May 12 14:41:18.747900 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 244/470] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:18 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:18.789903 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.797961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4550bcf3-a3b3-498f-beb4-2b89d9f02fee tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.244006 May 12 14:41:18.798628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 227/471] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:18 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:19.150215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-023691da-e3a0-441d-bb04-4c0cee64a8e6 req-5f394027-6939-4a4d-99ad-52b9b8e34265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e248f403-7a65-42e2-a6b4-1f6c347a2e2e", "name": "network-vif-plugged", "status": "completed", "tag": "2c2c830c-addb-4ce9-8ac8-ee700f599af2"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:19.158978 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-023691da-e3a0-441d-bb04-4c0cee64a8e6 req-5f394027-6939-4a4d-99ad-52b9b8e34265 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.159423 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-023691da-e3a0-441d-bb04-4c0cee64a8e6 req-5f394027-6939-4a4d-99ad-52b9b8e34265 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.171840 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-023691da-e3a0-441d-bb04-4c0cee64a8e6 req-5f394027-6939-4a4d-99ad-52b9b8e34265 service nova] Creating event network-vif-plugged:2c2c830c-addb-4ce9-8ac8-ee700f599af2 for instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e on hv-cinder-84067 May 12 14:41:19.177596 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-023691da-e3a0-441d-bb04-4c0cee64a8e6 req-5f394027-6939-4a4d-99ad-52b9b8e34265 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 May 12 14:41:19.178213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 245/472] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:19.290182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:19.291000 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:19.300603 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.301345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.302460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.303078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.443952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:19.452148 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0b240ba5-3ce5-4d63-ac68-97013d5c9ae6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1261 microversion: 2.1 time: 0.168181 May 12 14:41:19.452700 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 228/473] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:19 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:19.768556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:19.769355 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:19.776269 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.776707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.777482 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.777912 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.816702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:19.817278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:19.824596 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.825096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.826236 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.826777 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.969970 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:19.978898 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:19.980651 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:19.981968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7c61a8d3-47e3-4a6f-b8cb-3c56f71ee2a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.218345 May 12 14:41:19.982654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 246/474] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:19 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:20.002912 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.011391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ba2eb424-be42-43e0-b3d8-b9b78b6ec657 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.200120 May 12 14:41:20.012124 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 229/475] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:19 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:20.469603 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:20.470206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:20.476817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.477260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.478012 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.478436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.618736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.630552 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-011770a2-4eb3-4327-bd7f-158c22c73b52 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1445 microversion: 2.1 time: 0.164385 May 12 14:41:20.631121 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 247/476] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:20 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:20.652076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:20.652681 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:20.658922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.659357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.660145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.660566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.801344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.809506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0fcc28c8-05df-4737-858c-21cb47c93787 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1445 microversion: 2.1 time: 0.161111 May 12 14:41:20.810080 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 230/477] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:20 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1445 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:21.000875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:21.001693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:21.009439 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.010007 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.010861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.011370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.029364 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:21.029975 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:21.036972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.037484 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.038320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.038748 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.510395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.518755 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.520517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.521776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b0fd1d3b-2c5e-490e-b338-ffb82ce85730 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.524972 May 12 14:41:21.522348 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 248/478] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:20 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:21.540332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.548165 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-394a8b8e-1187-4ee2-b7e0-88584953fbe2 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.522582 May 12 14:41:21.548755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 231/479] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:21 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:22.541582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:22.542137 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:22.549291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.549737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.550533 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.550961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.565635 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:22.566240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:22.572956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.573326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.574552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.574972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.845629 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.855294 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.856876 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.858450 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cae5d310-4dd7-4bfc-bdf5-f014d8c7a599 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.321386 May 12 14:41:22.859058 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 249/480] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:22 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:22.885594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.893802 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0f3cb47d-8790-4aae-a5b9-b4b8a810ae51 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1318 microversion: 2.1 time: 0.332340 May 12 14:41:22.894444 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 232/481] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:22 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:23.559654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-800e1408-0621-43a8-8828-1ef98c831038 req-205d4ba9-9795-4e98-beeb-e558752d47aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9198b32a-74d2-4298-bed5-be716180d682", "tag": "5e60855e-b1bf-4dc0-8a72-5c0e800298c2"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:23.568364 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-800e1408-0621-43a8-8828-1ef98c831038 req-205d4ba9-9795-4e98-beeb-e558752d47aa service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.568902 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-800e1408-0621-43a8-8828-1ef98c831038 req-205d4ba9-9795-4e98-beeb-e558752d47aa service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.579630 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-800e1408-0621-43a8-8828-1ef98c831038 req-205d4ba9-9795-4e98-beeb-e558752d47aa service nova] Creating event network-changed:5e60855e-b1bf-4dc0-8a72-5c0e800298c2 for instance 9198b32a-74d2-4298-bed5-be716180d682 on hv-cinder-84067 May 12 14:41:23.584603 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-800e1408-0621-43a8-8828-1ef98c831038 req-205d4ba9-9795-4e98-beeb-e558752d47aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028648 May 12 14:41:23.585236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 250/482] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:23.878179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:23.878740 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:23.885700 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.886400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.887401 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.887830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.911103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:23.912199 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:23.919401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.920098 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.921048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.921628 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:24.175649 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.184395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.185922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.187094 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8dd0cd79-af1f-4d17-8553-d74125fbc94c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.313052 May 12 14:41:24.188194 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 233/483] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:23 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:24.201145 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.211317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-38e45e6f-23fa-4d6f-9d06-7dd17ef6076e tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1506 microversion: 2.1 time: 0.304537 May 12 14:41:24.212195 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 251/484] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:23 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:24.232495 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6f9c45dc-337b-4a5e-a01d-ddf5a49c0964 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f085471a-aa9a-4181-911b-72bfa2464243", "device": "/dev/sdb"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:24.234807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6f9c45dc-337b-4a5e-a01d-ddf5a49c0964 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:24.241348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6f9c45dc-337b-4a5e-a01d-ddf5a49c0964 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:24.241840 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6f9c45dc-337b-4a5e-a01d-ddf5a49c0964 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:24.242583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6f9c45dc-337b-4a5e-a01d-ddf5a49c0964 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:24.243016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6f9c45dc-337b-4a5e-a01d-ddf5a49c0964 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:24.544166 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6f9c45dc-337b-4a5e-a01d-ddf5a49c0964 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "POST /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315018 May 12 14:41:24.544933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 234/485] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:41:24 2022] POST /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:25.212079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:25.212691 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:25.219158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.219614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.220392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.220818 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.352964 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.361352 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.362854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.364045 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d76dca42-dc0c-4588-9489-c15b2374d8ed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.155971 May 12 14:41:25.364618 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 252/486] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:25 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:26.384553 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:26.385461 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:26.394869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.395464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.396508 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.397056 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.538771 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.551576 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.553861 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.555051 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e2ac658d-a84b-4804-914e-20f4e4f4be4b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.176417 May 12 14:41:26.555622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 235/487] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:26 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:27.574660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:27.575291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:27.582731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.583223 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:27.584100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.584584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:27.723012 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:27.731066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:27.732571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:27.733718 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8f6bad47-e2fb-4ecf-a837-ed3ac2bb19f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.163529 May 12 14:41:27.734294 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 253/488] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:27 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:28.756967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:28.757904 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:28.767778 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:28.768504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:28.769716 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:28.770367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:28.901486 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:28.909806 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:28.911286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:28.912441 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b5cdac7b-fa87-4ba6-8366-54e1ad92febe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.162296 May 12 14:41:28.913023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 236/489] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:28 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:29.699541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7c6d2182-cb7e-473c-9d65-61cbc982c9c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:29.700137 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7c6d2182-cb7e-473c-9d65-61cbc982c9c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:29.706682 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c6d2182-cb7e-473c-9d65-61cbc982c9c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.707123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c6d2182-cb7e-473c-9d65-61cbc982c9c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.707926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c6d2182-cb7e-473c-9d65-61cbc982c9c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.708349 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7c6d2182-cb7e-473c-9d65-61cbc982c9c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.731655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7c6d2182-cb7e-473c-9d65-61cbc982c9c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/ips" status: 200 len: 146 microversion: 2.1 time: 0.035899 May 12 14:41:29.732259 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 254/490] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:41:29 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:29.932020 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:29.932599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:29.939439 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.939923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.940688 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.941114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:30.081159 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.090576 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.092198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.093372 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-024ee59c-3250-428e-a451-e9f2bb46a2c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.165553 May 12 14:41:30.093953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 237/491] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:29 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:31.112171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:31.112875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:31.120046 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.120497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.121282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.121718 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.232032 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-0aa4088f-bec1-411d-a2e8-44ef3ba8fa80 req-0ea2121c-6d81-4297-8aad-d763471567e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbaf2e7-9702-48d5-8a0e-5088f269f7f1", "name": "network-vif-plugged", "status": "completed", "tag": "b36316ae-0793-416c-9119-9819353b009c"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:31.241747 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-0aa4088f-bec1-411d-a2e8-44ef3ba8fa80 req-0ea2121c-6d81-4297-8aad-d763471567e8 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.242418 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-0aa4088f-bec1-411d-a2e8-44ef3ba8fa80 req-0ea2121c-6d81-4297-8aad-d763471567e8 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.253668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.256626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-0aa4088f-bec1-411d-a2e8-44ef3ba8fa80 req-0ea2121c-6d81-4297-8aad-d763471567e8 service nova] Creating event network-vif-plugged:b36316ae-0793-416c-9119-9819353b009c for instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 on hv-cinder-84067 May 12 14:41:31.261972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-0aa4088f-bec1-411d-a2e8-44ef3ba8fa80 req-0ea2121c-6d81-4297-8aad-d763471567e8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033659 May 12 14:41:31.262566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 238/492] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:41:31.262704 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.264194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.265354 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2f7f53c7-fd46-4252-9655-63106e5ff3df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.157296 May 12 14:41:31.265903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 255/493] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:31 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:32.284954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.285843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:32.293827 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.294648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:32.295481 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.295955 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:32.452559 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:32.461242 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:32.462750 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:32.463957 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ffefdc11-bd46-460e-8f4f-f3aaf6a8507a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.184240 May 12 14:41:32.464541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 239/494] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:32.926234 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-84070a82-2833-4a36-af09-43e96b9a31bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.926909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-84070a82-2833-4a36-af09-43e96b9a31bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:32.935110 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84070a82-2833-4a36-af09-43e96b9a31bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.935668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84070a82-2833-4a36-af09-43e96b9a31bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:32.936658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84070a82-2833-4a36-af09-43e96b9a31bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.937207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-84070a82-2833-4a36-af09-43e96b9a31bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:32.962060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-84070a82-2833-4a36-af09-43e96b9a31bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/ips" status: 200 len: 150 microversion: 2.1 time: 0.040662 May 12 14:41:32.962642 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 256/495] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:33.482832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:33.483399 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:33.490121 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:33.490556 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:33.491339 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:33.491789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:33.628155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:33.636550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:33.638029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:33.639504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6171e961-a4b9-443c-83ba-b6401a145f07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.160281 May 12 14:41:33.640113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 240/496] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:33 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:34.488328 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ba9d85f1-0873-4949-b38a-4086c63acbe1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3a31014-9e6f-4d48-aa29-40da72514dce"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:34.489402 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ba9d85f1-0873-4949-b38a-4086c63acbe1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:34.496857 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ba9d85f1-0873-4949-b38a-4086c63acbe1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:34.497335 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ba9d85f1-0873-4949-b38a-4086c63acbe1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.498126 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ba9d85f1-0873-4949-b38a-4086c63acbe1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:34.498548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ba9d85f1-0873-4949-b38a-4086c63acbe1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.658754 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:34.659417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:34.668662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:34.669105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.669866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:34.670294 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.811976 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:34.820390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:34.822019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:34.823191 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c32e0968-9f9c-4308-93d9-6b723ddc8e4a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.169046 May 12 14:41:34.823799 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 241/497] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:34 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:34.837546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ba9d85f1-0873-4949-b38a-4086c63acbe1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353048 May 12 14:41:34.838262 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 257/498] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:41:34 2022] POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:35.842726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.843409 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:35.850642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:35.851174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:35.852137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:35.852572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:35.985271 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:35.995290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:35.996804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:35.997950 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-883c67e3-3413-4f71-9e92-5ff99f95bdef tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.159255 May 12 14:41:35.998514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 242/499] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:37.017748 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:37.018434 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:37.025568 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:37.026007 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:37.026766 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:37.027192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:37.166292 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:37.175029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:37.176539 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:37.177689 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5a5a38f6-2557-42c0-847f-1277f92385ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.164672 May 12 14:41:37.178259 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 258/500] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:37 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:38.196933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:38.197535 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:38.204959 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:38.205404 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:38.206164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:38.206583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:38.348254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:38.360909 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:38.363195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:38.364918 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a85878dc-98b1-4e50-8ae7-c53305111d16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.172133 May 12 14:41:38.365679 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 243/501] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:38 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:39.384527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:39.385135 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:39.392013 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:39.392462 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:39.393228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:39.393660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:39.555156 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:39.567735 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:39.567735 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:39.567735 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b1d1d613-b8c7-44eb-bb4b-63656ada217e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.186805 May 12 14:41:39.568054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 259/502] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:39 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:40.585178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:40.585809 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:40.592539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:40.592988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:40.593752 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:40.594186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:40.733633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:40.741661 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:40.743196 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:40.744411 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4de2327b-46e6-4c5f-a0a9-fb9843073cf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.163158 May 12 14:41:40.744983 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 244/503] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:40 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:41.735475 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-59b6c547-a14b-4631-af11-4465b142b658 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "334ececd-84ab-4f6e-921f-2bd68a48f0c6"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:41.736513 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-59b6c547-a14b-4631-af11-4465b142b658 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:41.743021 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59b6c547-a14b-4631-af11-4465b142b658 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:41.743532 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59b6c547-a14b-4631-af11-4465b142b658 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:41.744334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59b6c547-a14b-4631-af11-4465b142b658 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:41.744773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-59b6c547-a14b-4631-af11-4465b142b658 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:41.762496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:41.763102 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:41.769647 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:41.770074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:41.770826 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:41.771256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:41.900264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:41.908495 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:41.909988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:41.911146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7df9377f-6a9c-4a8a-9ade-ef84ca7eac17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.152667 May 12 14:41:41.911898 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 245/504] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:41 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:42.932813 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:42.933519 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:42.940300 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.940721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.941474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.941898 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:43.088622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:43.096799 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:43.098309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:43.099519 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1e70552f-443e-461b-a1d2-d2dc78820404 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.171842 May 12 14:41:43.100129 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 246/505] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:42 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:44.119671 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:44.120512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:44.128768 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:44.129296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:44.130195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:44.130703 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:44.269348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:44.278435 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:44.279982 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:44.281142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3d02d7e6-2521-4091-abbc-b0258f2e4f4c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1743 microversion: 2.20 time: 0.166249 May 12 14:41:44.281712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 247/506] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:44 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:45.304123 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:45.305328 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:45.313255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:45.313759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:45.314616 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:45.315135 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:45.450397 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:45.458698 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:45.460231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:45.461472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-99a0fd7e-21bd-464d-8ea7-e432ad650a44 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.163898 May 12 14:41:45.462355 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 248/507] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:45 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:46.275588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-59b6c547-a14b-4631-af11-4465b142b658 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.543967 May 12 14:41:46.276262 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 260/508] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:41:41 2022] POST /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments => generated 194 bytes in 4546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:46.480580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:46.481783 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:46.489473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:46.490083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:46.491210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:46.491820 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:46.628917 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:46.637289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:46.638787 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:46.639965 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b2dd523d-1408-4ede-ae56-7530e08f77b7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.163441 May 12 14:41:46.640533 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 249/509] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:46 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:47.659363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:47.660735 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:47.669015 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:47.669847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:47.670724 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:47.671310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:47.814387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:47.823160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:47.824872 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:47.826050 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0f7fbb4a-c6f1-44e3-a0a1-27bff12fcd56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.171333 May 12 14:41:47.826614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 261/510] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:47 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:48.844859 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:48.846214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:48.854141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.854589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.855379 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.855869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:49.007428 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:49.016313 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:49.017809 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:49.018971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-17b6e079-3870-4e78-81a4-219e9e84be8f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.179185 May 12 14:41:49.019538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 250/511] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:48 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:50.037725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:50.039252 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:50.046401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:50.047069 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:50.048042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:50.048912 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:50.188905 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:50.198033 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:50.200205 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:50.201371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6f84f35d-6a45-45f0-be0f-b4db21bb5050 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.167696 May 12 14:41:50.201943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 262/512] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:50 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:51.220271 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:51.220909 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:51.228047 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:51.228525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:51.229296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:51.229760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:51.310729 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:51.311341 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:51.318301 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:51.319000 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:51.320030 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:51.320659 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:51.380674 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:51.390390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:51.392295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:51.393501 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fa348179-28ce-4a70-95b0-e542c067e08e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.177232 May 12 14:41:51.401455 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 251/513] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:51 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:51.416554 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lazy-loading 'services' on Instance uuid e248f403-7a65-42e2-a6b4-1f6c347a2e2e {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:41:51.492277 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-26903f44-12e9-4093-a431-593ac5d5b61c tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e/os-volume_attachments/f085471a-aa9a-4181-911b-72bfa2464243" status: 202 len: 0 microversion: 2.1 time: 0.185320 May 12 14:41:51.493095 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 263/514] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:41:51 2022] DELETE /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e/os-volume_attachments/f085471a-aa9a-4181-911b-72bfa2464243 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:41:52.412385 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:52.413642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:52.421805 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:52.422507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:52.423457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:52.423905 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:52.563141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:52.571699 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:52.573278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:52.574715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a9c665e0-ee09-4059-8d8d-9be3b4ce8b85 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.166327 May 12 14:41:52.575447 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 252/515] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:52 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:53.595331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:53.596213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:53.603655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:53.604115 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:53.604890 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:53.605367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:53.774357 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:53.784331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:53.785817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:53.787030 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1805a58c-3b16-4902-bda2-ab883a85db58 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.197643 May 12 14:41:53.787632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 264/516] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:53 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:54.806433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:54.807775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:54.825727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:54.827890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:54.828769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:54.829199 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:55.020941 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:55.030379 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:55.033615 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:55.034990 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-be507fae-0ba1-4402-9a7f-a24966c58a79 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.232810 May 12 14:41:55.047578 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 253/517] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:54 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:55.116501 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-677ede1e-cab6-4185-a69b-b3c477f8760b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:55.125375 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-677ede1e-cab6-4185-a69b-b3c477f8760b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:55.125826 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-677ede1e-cab6-4185-a69b-b3c477f8760b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:55.190436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-677ede1e-cab6-4185-a69b-b3c477f8760b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Going to try to stop instance {{(pid=123725) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 14:41:55.241159 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-677ede1e-cab6-4185-a69b-b3c477f8760b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action" status: 202 len: 0 microversion: 2.1 time: 0.129849 May 12 14:41:55.245376 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 265/518] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:41:55 2022] POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:41:55.254611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:55.255232 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:55.263842 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:55.264617 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:55.265542 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:55.266958 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:55.425582 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:55.434563 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-24574d5f-31f5-4776-acfb-6f22c5ff4fc8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.183854 May 12 14:41:55.435146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 254/519] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:55 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:56.055232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:56.055845 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:56.063478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:56.064236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:56.065513 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:56.066071 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:56.242227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:56.250926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:56.252577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:56.253771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-75e27c2b-7052-40c2-a9aa-11bbac244222 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.203408 May 12 14:41:56.254506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 266/520] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:56 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:56.452457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:56.453086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:56.460186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:56.460630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:56.461387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:56.461808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:56.597372 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:56.606453 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8524c898-fcc1-4762-9603-fac85efa1e53 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.157812 May 12 14:41:56.607035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 255/521] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:56 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:57.273158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:57.274361 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:57.281337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:57.282077 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:57.282851 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:57.283281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:57.421001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:57.429397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:57.431158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:57.432477 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2d861c7e-3c85-4ea2-b96a-7eebd93f6c1c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.163220 May 12 14:41:57.436638 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 267/522] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:57 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:57.624315 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:57.624852 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:57.631411 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:57.632089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:57.633034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:57.633472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:57.779624 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:57.787972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-346060d4-9456-439f-9bd2-f8299bd60ea4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.167963 May 12 14:41:57.788547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 256/523] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:57 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:58.454675 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:58.455669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:58.465421 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:58.465924 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:58.466893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:58.467114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:58.607914 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:58.620413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:58.621926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:58.623184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2e7c5e9e-ea6b-4b85-a908-79d1b56d6454 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1738 microversion: 2.20 time: 0.175065 May 12 14:41:58.623785 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 268/524] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:58 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:58.809946 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:58.810894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:58.822407 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:58.822827 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:58.823666 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:58.824183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:58.976801 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:58.986880 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-738b6080-3d6d-4234-967a-d9b90f023b64 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.183811 May 12 14:41:58.990090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 257/525] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:41:58 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:59.641724 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:59.642547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:59.649247 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:59.649632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:59.650459 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:59.650858 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:59.860700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:59.869877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:59.871378 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:59.872573 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3a6d075f-d8d4-432d-8132-8eba6771339c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1720 microversion: 2.20 time: 0.234785 May 12 14:41:59.873114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 269/526] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:41:59 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:00.015061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:00.015964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:00.026563 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:00.026984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:00.027814 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:00.028247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:00.169330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:00.178044 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d7bab8cc-65f6-4f3c-984f-60d205fa95b0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.169759 May 12 14:42:00.178627 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 258/527] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:00 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:00.891782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:00.892383 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:00.899866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:00.900425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:00.901188 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:00.901617 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:01.037630 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:01.047672 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:01.049197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:01.050367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-157b2b61-07e3-45f0-86c2-f8b4fa11a31f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1720 microversion: 2.20 time: 0.162543 May 12 14:42:01.050932 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 270/528] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:00 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:01.197765 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:01.198365 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:01.204998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:01.205437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:01.206202 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:01.206630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:01.336564 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:01.344941 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-656d5ba7-473a-457a-a65c-4ab6ff0510fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.153236 May 12 14:42:01.345506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 259/529] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:01 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:01.356642 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-8998bd9b-036b-4edf-b4f2-7b8aa0d00cb1 req-771fbdae-b45e-4e1b-bbff-b22925100d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbaf2e7-9702-48d5-8a0e-5088f269f7f1", "name": "network-vif-unplugged", "status": "completed", "tag": "b36316ae-0793-416c-9119-9819353b009c"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:01.366968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-8998bd9b-036b-4edf-b4f2-7b8aa0d00cb1 req-771fbdae-b45e-4e1b-bbff-b22925100d58 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:01.367403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-8998bd9b-036b-4edf-b4f2-7b8aa0d00cb1 req-771fbdae-b45e-4e1b-bbff-b22925100d58 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:01.381330 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-8998bd9b-036b-4edf-b4f2-7b8aa0d00cb1 req-771fbdae-b45e-4e1b-bbff-b22925100d58 service nova] Creating event network-vif-unplugged:b36316ae-0793-416c-9119-9819353b009c for instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 on hv-cinder-84067 May 12 14:42:01.386626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-8998bd9b-036b-4edf-b4f2-7b8aa0d00cb1 req-771fbdae-b45e-4e1b-bbff-b22925100d58 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034559 May 12 14:42:01.387258 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 271/530] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:02.073008 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:02.073675 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:02.080930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:02.081417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:02.082254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:02.082724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:02.220693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:02.229286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:02.230801 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:02.232013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-94b0b527-f406-4e9c-8d1d-0e662a8e2430 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1720 microversion: 2.20 time: 0.165465 May 12 14:42:02.232591 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 260/531] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:02 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:02.366199 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:02.367064 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:02.374885 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:02.375337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:02.376164 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:02.376602 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:02.514049 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:02.523037 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ea465dbe-0f65-494e-a470-7c896221d5fa tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.163781 May 12 14:42:02.523647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 272/532] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:02 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:03.252747 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:03.253430 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:03.262643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.263265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.264485 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.265125 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.399021 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:03.411491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:03.413843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:03.415870 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7d126e8d-c157-4744-9b6c-fb0eb5c02999 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1723 microversion: 2.20 time: 0.168785 May 12 14:42:03.416472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 261/533] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:03 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:03.434272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1f851f5f-770e-4ce7-8d04-486268776051 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a156869a-f972-49ad-9bfa-17815bb1713b"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:03.435412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1f851f5f-770e-4ce7-8d04-486268776051 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:03.442529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f851f5f-770e-4ce7-8d04-486268776051 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.442918 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f851f5f-770e-4ce7-8d04-486268776051 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.443710 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f851f5f-770e-4ce7-8d04-486268776051 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.444142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f851f5f-770e-4ce7-8d04-486268776051 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.540940 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:03.541729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:03.550326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.551146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.552217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.552794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.690650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:03.699420 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f00e40e8-2ef7-4296-b002-c11072833b1d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.162646 May 12 14:42:03.700446 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 262/534] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:03 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:42:03.735870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1f851f5f-770e-4ce7-8d04-486268776051 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305642 May 12 14:42:03.736502 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 273/535] 10.222.0.79 () {62 vars in 1363 bytes} [Thu May 12 14:42:03 2022] POST /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:42:03.848894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-88334cd4-b25e-4557-8b27-6ab3aedfe77d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:03.849459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-88334cd4-b25e-4557-8b27-6ab3aedfe77d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:03.855945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88334cd4-b25e-4557-8b27-6ab3aedfe77d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.856391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88334cd4-b25e-4557-8b27-6ab3aedfe77d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.857156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88334cd4-b25e-4557-8b27-6ab3aedfe77d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.857588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-88334cd4-b25e-4557-8b27-6ab3aedfe77d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.963033 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-88334cd4-b25e-4557-8b27-6ab3aedfe77d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/action" status: 202 len: 0 microversion: 2.20 time: 0.117686 May 12 14:42:03.963680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 263/536] 10.222.0.79 () {62 vars in 1318 bytes} [Thu May 12 14:42:03 2022] POST /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:42:03.972039 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:03.972654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:03.979492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.979978 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.980757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.981199 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:04.115808 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:04.124231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:04.125752 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:04.126927 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-68750d98-6360-4357-8225-087e25260c48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1749 microversion: 2.20 time: 0.158899 May 12 14:42:04.127493 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 274/537] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:03 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:04.454511 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-828fab98-6d03-4a34-8e21-3e6f5b305fec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: .version_select at 0x7f4650b58b80>, body: {"keypair": {"name": "tempest-keypair-592418548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWEbykG8h5AlTsJK/vLWYxSDTWpE5uvEkQ91gNpofC6Aq4wqE3Os8VxlrOwO4qNy7bYjHaJWkshlyBQay5QcAo7IOIxk93Na5kHng4KVVKHH+08H6CTVXL8HkmV4fFBkQ=="}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:04.470452 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-828fab98-6d03-4a34-8e21-3e6f5b305fec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:42:04.474673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-828fab98-6d03-4a34-8e21-3e6f5b305fec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:42:04.499856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-828fab98-6d03-4a34-8e21-3e6f5b305fec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049838 May 12 14:42:04.500450 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 264/538] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:42:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:04.717991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:04.718591 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:04.732694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:04.733175 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:04.734271 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:04.734708 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:04.882052 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:04.890222 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b2d434c0-d220-466b-a220-3e264d460a6a tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.176661 May 12 14:42:04.890902 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 275/539] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:04 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:05.145549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:05.146162 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:05.152588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.153074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.153948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.154373 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.304753 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:05.323230 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:05.324658 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:05.325832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0db5f03f-8e9d-4054-b57c-0fe96dc35b9c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1751 microversion: 2.20 time: 0.184344 May 12 14:42:05.326405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 265/540] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:05 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:05.361716 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:05.362226 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:05.369282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.370015 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.370821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.371255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.397152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:42:05.476282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d0603c4d-a3e8-446d-a680-3014438ec5a3 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 204 len: 0 microversion: 2.1 time: 0.118142 May 12 14:42:05.477181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 276/541] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:42:05 2022] DELETE /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 14:42:05.486101 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:05.486726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:05.493147 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.493649 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.494550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.495051 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.625337 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:05.633034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ea0e29cb-175b-4e11-adbd-6d39bf7cb464 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1512 microversion: 2.1 time: 0.150942 May 12 14:42:05.633610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 266/542] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:05 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:42:05.909500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:05.910183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:05.916977 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.917389 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.918517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.918946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.930345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2004009102", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d1d321-0090-41ca-9dd0-9f717585a523"}], "security_groups": [{"name": "tempest-securitygroup--260453292"}], "key_name": "tempest-keypair-592418548", "user_data": "}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:06.076656 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] validate_networks() for [('45d1d321-0090-41ca-9dd0-9f717585a523', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:42:06.100368 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.108594 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6584361b-4904-40a3-a07e-35ea44ffaa9d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.203429 May 12 14:42:06.109152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 277/543] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:05 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:06.346846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:06.347517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:06.354321 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.354772 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.355541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.355996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.518174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:42:06.518677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:42:06.519050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:42:06.519457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:42:06.519900 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:42:06.529906 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.530348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.531169 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.531637 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.541584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.548955 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:42:06.550344 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.551917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.553116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-66028ba7-2851-4d17-970b-7cab4b458d1a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1751 microversion: 2.20 time: 0.210238 May 12 14:42:06.553258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:42:06.553670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 278/544] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:06 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:42:06.565122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:42:06.568666 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:42:06.616578 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7d8f0db0-f6b4-4329-949b-b43a748fa792 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.690513 May 12 14:42:06.617141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 267/545] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:42:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:42:06.627454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a744daad-c352-4737-89cd-f836543bcab1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:06.628189 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a744daad-c352-4737-89cd-f836543bcab1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:06.649602 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:06.650265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:06.656568 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.656998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.657741 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.658348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.685273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a744daad-c352-4737-89cd-f836543bcab1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.692744 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a744daad-c352-4737-89cd-f836543bcab1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1241 microversion: 2.1 time: 0.069158 May 12 14:42:06.694173 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 279/546] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:06 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:06.796445 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.804474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-57f870b0-1536-47aa-9c17-68aa93746560 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1512 microversion: 2.1 time: 0.158725 May 12 14:42:06.805022 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 268/547] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:06 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:07.125975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:07.126577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:07.133700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.134190 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.135194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.135725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.279076 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:07.287526 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b485f581-da7d-4a82-a2c2-44cf8aa796c3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.165536 May 12 14:42:07.288131 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 280/548] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:07 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:07.573048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:07.573592 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:07.581093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.581618 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.582474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.582948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.710581 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:07.711394 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:07.718159 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.718984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.719807 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.720245 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.995242 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.005133 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.006789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.008038 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c0106217-430c-4976-800c-1071b1b2b87d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1751 microversion: 2.20 time: 0.439461 May 12 14:42:08.008680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 269/549] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:07 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1751 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:08.014003 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:08.014640 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:08.020257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.020689 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:08.021136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:08.021912 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:08.022317 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:08.027896 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-537b9f45-cda6-4cde-86fa-aa6e2f78090c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1293 microversion: 2.1 time: 0.321481 May 12 14:42:08.028488 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 281/550] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:07 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1293 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:08.159247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.166689 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-92c07e1f-d24b-43d8-ab64-1849728502ac tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1512 microversion: 2.1 time: 0.157035 May 12 14:42:08.167261 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 270/551] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:08 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:08.306795 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:08.307331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:08.314804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:08.315259 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:08.316067 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:08.316503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:08.457411 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.465874 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-57b6bb7b-60e0-4dff-a892-116c5c773258 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.163212 May 12 14:42:08.466442 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 282/552] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:08 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:09.026622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:09.027227 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:09.034211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.034879 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.035897 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.036299 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.051338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:09.053088 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:09.060876 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.061305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.062255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.062893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.175934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.184594 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-72635658-ad2f-4fb9-b19b-e22755ea37c2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1299 microversion: 2.1 time: 0.137703 May 12 14:42:09.185231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 283/553] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:09 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:09.189977 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:09.190760 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:09.197450 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.197906 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.198688 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.199142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.324319 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691afedb8d7c4ae3a69843fe6198c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.332124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d2dc4aa1-923c-494e-9c7c-197a8a19a785 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 200 len: 1470 microversion: 2.1 time: 0.145683 May 12 14:42:09.341910 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 284/554] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:09 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:09.367119 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-c6f56d54-54f1-4248-9096-df2473a96d1d req-0b63a961-52a7-4225-bf54-5b95927cfb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e248f403-7a65-42e2-a6b4-1f6c347a2e2e", "name": "network-vif-deleted", "tag": "2c2c830c-addb-4ce9-8ac8-ee700f599af2"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:09.375377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c6f56d54-54f1-4248-9096-df2473a96d1d req-0b63a961-52a7-4225-bf54-5b95927cfb5e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.375852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c6f56d54-54f1-4248-9096-df2473a96d1d req-0b63a961-52a7-4225-bf54-5b95927cfb5e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.387301 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-c6f56d54-54f1-4248-9096-df2473a96d1d req-0b63a961-52a7-4225-bf54-5b95927cfb5e service nova] Creating event network-vif-deleted:2c2c830c-addb-4ce9-8ac8-ee700f599af2 for instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e on hv-cinder-84067 May 12 14:42:09.387882 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.393475 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-c6f56d54-54f1-4248-9096-df2473a96d1d req-0b63a961-52a7-4225-bf54-5b95927cfb5e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029804 May 12 14:42:09.394340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 285/555] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:42:09.397419 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.399216 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.400417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7bb9fb56-d7e9-46a9-920a-b7408ad5332b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.377852 May 12 14:42:09.401032 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 271/556] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:09 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:09.483012 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:09.483717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:09.492488 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.493165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.494165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.494767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.712872 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.721867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-61e41754-b3a4-4a19-b543-3ca71db2eec9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.242946 May 12 14:42:09.722432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 286/557] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:09 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:10.203088 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:10.203804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:10.218327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.219307 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.220982 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.224865 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.349979 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:10.351365 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] [instance: e248f403-7a65-42e2-a6b4-1f6c347a2e2e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:10.358819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.359273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.360272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.360748 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.375611 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] HTTP exception thrown: Instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e could not be found. May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Request method failure captured: May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e HTTP/1.1 May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRwgaF6DDpzVuLISmIAUTyRiWU_xLJ8KT97MuCafll_8b3w4RfQ_4XfErlpm2QTWEsACQmMAu6eZnHekFgDNBtLP7umV1ttNYWKlUndeB59GRlZdsUWXGCRfEADVxMRe8vs4EB4iVp6DkQNb2aGshx0gE2OfwRQb2Yvi-6MphDXkhDU May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: ec6ea995239c47df80dd8c7ff0aa23f3 May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1023559131 May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:42:10.377503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec6ea995239c47df80dd8c7ff0aa23f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec6ea995239c47df80dd8c7ff0aa23f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec6ea995239c47df80dd8c7ff0aa23f3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec6ea995239c47df80dd8c7ff0aa23f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesSnapshotTestJSON-1023559131 May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: ec6ea995239c47df80dd8c7ff0aa23f3 May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1023559131 May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesSnapshotTestJSON-1023559131-project May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 691afedb8d7c4ae3a69843fe6198c210 May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesSnapshotTestJSON-1023559131-project May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e could not be found. May 12 14:42:10.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'e248f403-7a65-42e2-a6b4-1f6c347a2e2e'} May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e could not be found. May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:42:10.379813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e could not be found. May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e could not be found. May 12 14:42:10.381057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:42:10.385418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] Returning 404 to user: Instance e248f403-7a65-42e2-a6b4-1f6c347a2e2e could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:42:10.385418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c91235eb-c18b-46d5-a7c4-4fabed9e0397 tempest-VolumesSnapshotTestJSON-1023559131 tempest-VolumesSnapshotTestJSON-1023559131-project] 10.222.0.79 "GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e" status: 404 len: 111 microversion: 2.1 time: 0.033410 May 12 14:42:10.385418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 287/558] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:10 2022] GET /compute/v2.1/servers/e248f403-7a65-42e2-a6b4-1f6c347a2e2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:42:10.398574 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-66e36162-b9e7-4ce7-8682-3bc602ebffc9 req-41911f9c-6784-425d-80c9-1063f4495c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c58127-4521-4c68-b19f-9a016a0f3aad", "tag": "fb818443-c684-4571-8d0e-1911365e4b6b"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:10.412359 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:10.425113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c13cd0ac-2583-4afb-9f41-01c48ca736e8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.226892 May 12 14:42:10.437669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 272/559] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:10 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:10.440523 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-66e36162-b9e7-4ce7-8682-3bc602ebffc9 req-41911f9c-6784-425d-80c9-1063f4495c71 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.441228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-66e36162-b9e7-4ce7-8682-3bc602ebffc9 req-41911f9c-6784-425d-80c9-1063f4495c71 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.447867 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:10.450473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:10.464858 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-66e36162-b9e7-4ce7-8682-3bc602ebffc9 req-41911f9c-6784-425d-80c9-1063f4495c71 service nova] Creating event network-changed:fb818443-c684-4571-8d0e-1911365e4b6b for instance 42c58127-4521-4c68-b19f-9a016a0f3aad on hv-cinder-84067 May 12 14:42:10.468668 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.469186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.470054 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.470558 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.494586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-66e36162-b9e7-4ce7-8682-3bc602ebffc9 req-41911f9c-6784-425d-80c9-1063f4495c71 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113265 May 12 14:42:10.496754 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 288/560] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:10.682395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:10.700177 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:10.712356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:10.713476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-71325927-63ef-4448-8de8-7078947b829d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.274352 May 12 14:42:10.725889 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 273/561] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:10 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:10.739775 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:10.740618 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:10.779190 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.784432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.785616 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.786192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:11.023318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.034175 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6016a6a3-aee4-46df-b38b-8899edde0153 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.299199 May 12 14:42:11.035432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 289/562] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:10 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:11.455550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:11.456164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:11.463111 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:11.463782 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:11.464798 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:11.465192 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:11.603999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.612172 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-725d1d4c-931f-4f42-9d98-2026bc750b54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.160756 May 12 14:42:11.612721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 274/563] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:11 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:11.732858 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:11.733436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:11.740520 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:11.741112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:11.742066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:11.742497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:11.883928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.893940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.895484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.896771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-69211540-a14e-41c3-967f-2c98aee82da4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.167882 May 12 14:42:11.907850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 290/564] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:11 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:42:12.052610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:12.053219 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:12.065963 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.066412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:12.067205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.067680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:12.207843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:12.216354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a8ee3e7f-a818-42fc-9d56-55e6b344f9d9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.167741 May 12 14:42:12.217228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 275/565] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:12 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:12.629922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:12.630650 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:12.637109 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.637668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:12.638567 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.639038 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:12.770031 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:12.777886 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-556816ee-2973-4355-9893-b35ce74aa5fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.151805 May 12 14:42:12.778541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 291/566] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:12 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:12.915061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:12.915779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:12.923438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.923928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:12.924714 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.925149 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:13.086726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.098363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.100820 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.102561 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-21669f99-9ee1-4992-bbc1-cc8bd0b4c331 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.191442 May 12 14:42:13.103877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 276/567] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:12 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:13.233956 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:13.234563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:13.242593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:13.243814 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:13.244657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:13.245101 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:13.385946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.395097 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c3a5af17-cd97-4747-8588-b28164ea74f3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.165287 May 12 14:42:13.395709 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 292/568] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:13 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:13.795604 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:13.796146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:13.802631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:13.803079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:13.803944 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:13.804384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:13.945109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.954366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d3374027-d14c-45c1-b7c9-b625abcdd1f8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.163320 May 12 14:42:13.954954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 277/569] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:13 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:14.122230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:14.122846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:14.129312 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.129755 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:14.130522 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.130952 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:14.273216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:14.282804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:14.284367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:14.285648 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-19ca2deb-132d-42d3-9dab-f5bdc3a92a67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.167537 May 12 14:42:14.286226 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 293/570] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:14 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:14.413166 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:14.413740 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:14.422093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.422594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:14.423645 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.424204 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:14.566509 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:14.575414 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a1f0e125-82bc-438b-b13d-39d625525ecf tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.166604 May 12 14:42:14.576049 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 278/571] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:14 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:14.976024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:14.977034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:14.988024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.988773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:14.990053 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.990775 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:15.132100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.139898 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9aeb1cbe-782e-40c9-a080-0ac999d5839e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.170579 May 12 14:42:15.140476 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 294/572] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:14 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:15.308236 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:15.309494 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:15.320294 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:15.321020 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:15.322281 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:15.322998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:15.467200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.477128 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.478602 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.479836 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-de958181-9b27-4f23-ade3-de481df72a84 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.178103 May 12 14:42:15.480406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 279/573] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:15 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:15.602284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:15.603284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:15.613769 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:15.614508 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:15.615767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:15.616527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:15.753724 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.765798 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0cbcdfe7-f125-4d8b-8383-e88559e912f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.170022 May 12 14:42:15.766425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 295/574] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:15 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:16.161812 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:16.162841 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:16.171791 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.172245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.173004 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.173437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.328573 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.336149 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-50ad01e1-7d1b-42df-af22-52d856805eb8 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.180953 May 12 14:42:16.336723 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 280/575] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:16 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:16.499239 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:16.499969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:16.507052 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.507501 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.508313 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.508742 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.652108 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.663781 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.666419 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.668400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b6b1ef6b-e405-48fc-ade0-b651842b5972 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.173417 May 12 14:42:16.669243 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 296/576] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:16 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:16.786570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:16.787100 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:16.798478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.798478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.798478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.798478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.938034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.946586 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ccea369f-71dd-49a7-b221-3e15b580a7dd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.163904 May 12 14:42:16.947537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 281/577] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:16 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:17.355881 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:17.356759 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:17.365310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.365920 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.366955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.367575 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.500791 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:17.511417 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b325d0ca-e87a-421c-8d68-fb1a19df4333 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.160569 May 12 14:42:17.512255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 297/578] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:17 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:17.691320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:17.692314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:17.701761 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.702200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.702958 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.703385 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.839286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:17.848260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:17.849774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:17.850941 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7a198c89-f2af-4f98-91d0-68043f3daafd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.166266 May 12 14:42:17.851518 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 282/579] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:17 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:17.968174 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:17.968852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:17.976075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.976575 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.977440 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.977923 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:18.126195 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:18.134643 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bc881c64-9f4b-475f-9bea-672d6e78fa36 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.172424 May 12 14:42:18.135232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 298/580] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:17 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:18.529706 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:18.530306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:18.537050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:18.537499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:18.538277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:18.538726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:18.704310 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:18.712380 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-76359236-26b2-4ab5-87cc-c7397959be32 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.187037 May 12 14:42:18.713539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 283/581] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:18 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:18.869511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:18.870138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:18.876953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:18.877397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:18.878236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:18.878658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.023774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.032866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.034985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.036531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2376fd86-ba6f-43fe-a084-9d2503189e16 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.171031 May 12 14:42:19.039728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 299/582] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:18 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:19.152275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:19.152935 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:19.159498 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.159984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.160740 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.161164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.296245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.304888 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-aaa59c85-5e84-4fde-83e9-8269d9bf1b29 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.156474 May 12 14:42:19.305475 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 284/583] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:19 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:19.733850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:19.734608 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:19.742837 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.743386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.744418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.744967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.882795 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.890953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-594709a8-062b-46c2-9fce-53a50308bb8c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.163085 May 12 14:42:19.891533 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 300/584] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:19 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:20.056673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:20.057259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:20.063946 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.064657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.065619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.066046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.209163 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:20.217795 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:20.219303 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:20.220491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-cffaed1f-98b6-464e-a2ee-0c28dc653963 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.167947 May 12 14:42:20.221058 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 285/585] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:20 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:20.323864 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:20.324478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:20.331676 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.332173 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.332959 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.333395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.464839 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:20.473417 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e5f3ef32-5e10-48a3-9604-3918a7ff32e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.153629 May 12 14:42:20.474002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 301/586] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:20 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:20.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:20.909682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:20.916088 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.916522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.917278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.917702 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.068205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.076532 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3d8ef1ed-8907-4c53-a98a-a9dd4c5ed84a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.172180 May 12 14:42:21.077171 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 286/587] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:20 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:21.238943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:21.239540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:21.246446 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.246870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.247655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.248114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.392132 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.400658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.402103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.403464 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6eb1fd01-2267-492d-a9cd-1b33d39bb6df tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.168450 May 12 14:42:21.404323 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 302/588] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:21 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:21.490505 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:21.491119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:21.497900 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.498712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.499730 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.500351 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.639024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.648379 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-55fe2b10-6396-40e8-8453-d1f438e19770 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.161675 May 12 14:42:21.649073 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 287/589] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:21 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:22.099548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:22.100344 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:22.107066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.108474 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.109474 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.109981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.244539 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:22.252761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-553c0682-616c-47da-af4e-d99f5c79552f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.157256 May 12 14:42:22.253343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 303/590] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:22 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:22.423069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:22.423735 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:22.430613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.431052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.431848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.432287 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.574938 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:22.588395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:22.590674 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:22.591991 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a36572b9-7fd3-432e-a85e-4b50a058c7b8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.173104 May 12 14:42:22.592555 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 288/591] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:22 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:22.666792 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:22.669302 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:22.676448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.677264 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.678435 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.679102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.831204 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:22.843755 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9912e3cf-113c-4489-b636-5d08049af529 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.181172 May 12 14:42:22.844360 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 304/592] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:22 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:23.269903 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:23.270504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:23.276538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.276982 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.277932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.278384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.422763 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:23.430723 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fdf5ab16-da57-40b2-95b8-2563b28832e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.164769 May 12 14:42:23.431426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 289/593] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:23 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:23.610907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:23.611520 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:23.618366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.618818 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.619582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.620047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.755047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:23.765989 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:23.768020 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:23.769231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cf61eed9-e8df-4200-8d8e-2f0bf6d1ae59 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.162291 May 12 14:42:23.769955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 305/594] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:23 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:23.861443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:23.861950 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:23.868877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.869407 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.870110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.870552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.018354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.026544 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-76c2b632-a25b-431f-b8c6-1fc04ed45b09 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.169062 May 12 14:42:24.027198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 290/595] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:23 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:24.447792 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:24.448310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:24.455469 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.455946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.456731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.457187 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.603899 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.611619 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5385cd5e-a965-4d01-8204-c0568d431d11 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.167871 May 12 14:42:24.612285 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 306/596] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:24 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:24.788652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:24.789241 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:24.797057 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.798012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.799143 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.799610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.939103 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.947934 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.949452 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.950698 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-18d86200-1552-4399-a644-8d58454434e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.166435 May 12 14:42:24.951267 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 291/597] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:24 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:25.044808 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:25.045428 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:25.052326 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.052847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:25.053624 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.054052 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:25.189958 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:25.198268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-33afe23d-1838-40d7-b231-01e3a981eff6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.158116 May 12 14:42:25.198854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 307/598] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:25 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:25.628781 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:25.629396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:25.635985 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.636432 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:25.637496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.638130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:25.776159 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:25.788202 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-25d1013f-493e-4299-9089-eb0a7a850636 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.163082 May 12 14:42:25.789004 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 292/599] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:25 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:25.971132 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:25.971870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:25.978821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.979347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:25.980278 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.980880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:26.116568 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:26.125412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:26.126916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:26.128193 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3fc52a82-9ad3-43fa-87b4-0353dc0ddb9f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.161742 May 12 14:42:26.128802 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 308/600] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:25 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:26.217500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:26.218114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:26.224767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:26.225212 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:26.225974 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:26.226402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:26.371971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:26.380437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c9838d4d-c61a-460a-b8cf-be6f3e0341e2 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.167085 May 12 14:42:26.381024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 293/601] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:26 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:26.811518 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:26.812416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:26.818996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:26.819441 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:26.820247 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:26.820672 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:26.960222 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:26.969569 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d51fc0b6-3784-4a1e-94ce-2a64aeb01daa tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.164626 May 12 14:42:26.970130 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 309/602] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:26 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:27.147875 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:27.148554 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:27.156080 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:27.156585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:27.157476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:27.157949 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:27.301800 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:27.310467 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:27.311993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:27.313215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b7c80ef3-3672-4b6d-97d5-f67fd56d5671 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.169790 May 12 14:42:27.313788 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 294/603] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:27 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:27.402687 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:27.403834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:27.414667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:27.415422 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:27.416746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:27.417478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:27.556524 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:27.566672 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ee054969-5529-4223-8c69-28fe937b7d38 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.170666 May 12 14:42:27.567244 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 310/604] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:27 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:27.990595 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:27.991588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:28.001737 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:28.002465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:28.003767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:28.004442 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:28.147212 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:28.155971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e669fbf5-d725-4a25-9189-7c6daf8b326e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.171715 May 12 14:42:28.156636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 295/605] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:27 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:28.336783 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:28.337774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:28.346767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:28.347166 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:28.347979 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:28.348408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:28.484946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:28.495539 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:28.497911 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:28.499877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a91ed89c-ef1c-4b89-84bb-67a0f133a8f6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.169545 May 12 14:42:28.500732 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 311/606] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:28 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:28.585008 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:28.585606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:28.592496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:28.592940 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:28.593845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:28.594272 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:28.727893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:28.736145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8e9ff4be-2266-4290-a386-fc2b8292c697 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.155004 May 12 14:42:28.736909 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 296/607] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:28 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:29.178227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:29.179215 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:29.188790 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:29.189240 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:29.190003 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:29.190436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:29.422820 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:29.434097 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c662f01d-9ec5-4b7a-a74c-0215a1de0223 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.262355 May 12 14:42:29.434837 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 312/608] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:29 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:29.522575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:29.523572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:29.533768 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:29.534513 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:29.535763 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:29.536496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:29.667400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:29.676057 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:29.677521 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:29.678665 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1b1c0255-1c07-4279-8989-b87db5afc214 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.162675 May 12 14:42:29.679219 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 297/609] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:29 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:29.755908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:29.756529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:29.763926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:29.764447 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:29.765583 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:29.766165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:29.903476 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:29.912932 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-032419ad-40ab-4c05-ad56-1bd87d66e968 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.161719 May 12 14:42:29.913513 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 313/610] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:29 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:42:30.459231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:30.460196 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:30.470479 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:30.471221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:30.472497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:30.473197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:30.609130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:30.619760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6dd51c48-0a3c-4519-947b-da29d56a0ba5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.166691 May 12 14:42:30.620504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 298/611] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:30 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:30.697327 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:30.697939 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:30.704828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:30.705280 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:30.706051 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:30.706487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:30.843010 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:30.852189 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:30.853686 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:30.854848 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c7eaa5ed-af38-432b-acb4-d265354235da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.161514 May 12 14:42:30.855416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 314/612] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:30 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:30.930752 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:30.931279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:30.937810 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:30.938253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:30.939014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:30.939440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:31.129136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:31.137542 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b9cb2394-b250-4813-aae7-67247bf794e1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1723 microversion: 2.1 time: 0.210737 May 12 14:42:31.138170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 299/613] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:30 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:31.641213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:31.641846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:31.650609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:31.651211 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:31.652355 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:31.652965 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:31.788850 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:31.796760 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-008c0170-9456-4d42-9c7d-67a58abc461d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.162011 May 12 14:42:31.797343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 315/614] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:31 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:31.876221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:31.876789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:31.884155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:31.884605 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:31.885402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:31.885864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.021969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:32.033335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:32.034827 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:32.036010 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7d466a2f-e9d7-46a3-bbb0-448e9b0f0aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.166176 May 12 14:42:32.036580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 300/615] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:31 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:32.157792 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:32.158469 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:32.166515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:32.167083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.168443 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:32.168989 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.311834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:32.320384 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3e911c55-4a87-4bad-8f32-8ecbcea19043 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1700 microversion: 2.1 time: 0.167917 May 12 14:42:32.320962 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 316/616] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:32 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1700 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:32.337212 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c1ab25bd-5e4d-40b8-a595-606a68a97250 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:32.343744 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c1ab25bd-5e4d-40b8-a595-606a68a97250 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:32.344217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c1ab25bd-5e4d-40b8-a595-606a68a97250 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.405863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c1ab25bd-5e4d-40b8-a595-606a68a97250 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Going to try to start instance {{(pid=123726) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 14:42:32.456721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c1ab25bd-5e4d-40b8-a595-606a68a97250 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action" status: 202 len: 0 microversion: 2.1 time: 0.123187 May 12 14:42:32.457255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 301/617] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:42:32 2022] POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:42:32.468379 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:32.469031 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:32.475365 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:32.475832 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.476597 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:32.477024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.623487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:32.635631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c4b9654a-f967-4a37-b51b-d0784f851841 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.173308 May 12 14:42:32.636484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 317/618] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:32 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:32.814427 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:32.815290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:32.825240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:32.825710 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.826485 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:32.826908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:32.959997 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:32.968887 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-58c606fb-a6bc-4613-8334-1665c413a6b4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.158854 May 12 14:42:32.969767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 302/619] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:32 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:33.054511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:33.055315 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:33.062500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:33.062964 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:33.063846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:33.064189 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:33.199127 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:33.208765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:33.210265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:33.211433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d2b2d05c-5b39-460d-8f46-87e9a50d00a0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.160917 May 12 14:42:33.212068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 318/620] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:33 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:33.657068 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:33.657676 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:33.663759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:33.664210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:33.664981 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:33.665413 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:33.799627 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:33.808389 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-92934cdd-1a66-4ea4-b03e-f2e01fd03a0f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.156329 May 12 14:42:33.808970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 303/621] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:33 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:33.988289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:33.988801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:33.994676 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:33.995113 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:33.995913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:33.996345 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:34.128525 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:34.135911 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6ddf2cd4-fd1a-4999-b55d-1be24e9512ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.152072 May 12 14:42:34.136492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 319/622] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:33 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:34.234158 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:34.235606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:34.242927 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:34.243407 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:34.244210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:34.244802 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:34.384181 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:34.394151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:34.395730 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:34.396898 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-bbee8140-2bdc-46d4-9688-ec2dde75c043 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.169962 May 12 14:42:34.397460 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 304/623] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:34 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:34.826464 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:34.827086 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:34.833506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:34.834006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:34.834764 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:34.835201 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:34.965484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:34.975158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0fba0bac-15e8-4975-ae8a-b400594bf58d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.152715 May 12 14:42:34.975766 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 320/624] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:34 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:35.154719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:35.155501 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:35.162562 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:35.163005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:35.163809 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:35.164237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:35.293100 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:35.300709 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7d162d35-4748-483b-8fda-cc40b9ff30e9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.150826 May 12 14:42:35.301567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 305/625] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:35 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:35.415999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:35.416613 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:35.423566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:35.424059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:35.424834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:35.425267 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:35.789882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:35.799530 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:35.801083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:35.802258 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-425aa1d7-7a85-436b-9eaa-5ff1bce7ae22 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.390276 May 12 14:42:35.802835 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 321/626] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:35 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:35.996661 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:35.997573 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:36.006328 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:36.006776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:36.007575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:36.008045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:36.142601 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:36.151625 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3badb119-3a69-4fc0-af13-beb02c75e9d6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.161659 May 12 14:42:36.152246 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 306/627] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:35 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:36.321089 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:36.321978 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:36.331952 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:36.332404 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:36.333177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:36.333609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:36.478046 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:36.485364 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cdb25c2c-f348-490f-9315-077c97510ca3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.171074 May 12 14:42:36.486260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 322/628] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:36 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:36.825347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:36.827362 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:36.835360 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:36.835838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:36.836684 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:36.837115 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:36.979728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:36.991124 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:36.992656 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:36.993827 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-696c306b-894b-4d16-be65-942f05f0940c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.175802 May 12 14:42:36.994404 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 307/629] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:36 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:37.178664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:37.179590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:37.189754 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:37.190906 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:37.191715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:37.192164 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:37.324955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:37.333577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a2a9aa9f-595c-4894-ae76-f91e7c10950f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.161754 May 12 14:42:37.334166 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 323/630] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:37 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:37.508051 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:37.511925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:37.526112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:37.526657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:37.527916 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:37.528406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:37.854260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:37.862130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-607ae726-c9cb-4b0a-a1db-53470142142b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.361816 May 12 14:42:37.869384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 308/631] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:37 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:38.012986 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:38.013606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:38.020351 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:38.020797 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:38.021566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:38.021993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:38.313589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:38.322815 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:38.324456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:38.325767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8c7f2c90-8132-456e-886a-53022f1be866 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.316940 May 12 14:42:38.326364 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 324/632] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:38 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:38.352430 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:38.353041 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:38.370148 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:38.371108 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:38.371971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:38.372610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:38.526575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:38.536273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-696fe92e-a5c0-467f-8ec3-eaacee581de8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.187545 May 12 14:42:38.536925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 309/633] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:38 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:38.879365 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:38.880098 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:38.886199 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:38.886664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:38.887415 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:38.887884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:39.018243 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:39.029406 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b34ff8b6-fedd-4bd5-bbc3-8ac842d123ba tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.153876 May 12 14:42:39.030473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 325/634] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:38 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:42:39.344981 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:39.345624 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:39.352202 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:39.352659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:39.353461 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:39.353856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:39.484810 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:39.498593 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:39.500575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:39.502345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-287bf4ac-5397-4390-a518-b5f99db2788d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.161206 May 12 14:42:39.503342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 310/635] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:39 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:39.561269 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:39.561866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:39.569810 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:39.570257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:39.571026 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:39.571460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:39.704652 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:39.717086 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0621b296-38e5-4ab3-87af-1b9f79501302 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.161674 May 12 14:42:39.717908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 326/636] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:39 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:40.048910 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:40.049588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:40.055799 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:40.056246 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:40.057007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:40.057456 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:40.205075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:40.212596 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8016ed44-6c4a-42f0-bfc7-5b751f0517ef tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.167592 May 12 14:42:40.213173 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 311/637] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:40 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:40.284136 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-657e732c-e2e4-42e0-a231-fea9d0955efc req-247dc67a-a96e-4bef-ba2e-b65abe082583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c58127-4521-4c68-b19f-9a016a0f3aad", "name": "network-vif-plugged", "status": "completed", "tag": "fb818443-c684-4571-8d0e-1911365e4b6b"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:40.293717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-657e732c-e2e4-42e0-a231-fea9d0955efc req-247dc67a-a96e-4bef-ba2e-b65abe082583 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:40.294143 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-657e732c-e2e4-42e0-a231-fea9d0955efc req-247dc67a-a96e-4bef-ba2e-b65abe082583 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:40.305566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-657e732c-e2e4-42e0-a231-fea9d0955efc req-247dc67a-a96e-4bef-ba2e-b65abe082583 service nova] Creating event network-vif-plugged:fb818443-c684-4571-8d0e-1911365e4b6b for instance 42c58127-4521-4c68-b19f-9a016a0f3aad on hv-cinder-84067 May 12 14:42:40.310564 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-657e732c-e2e4-42e0-a231-fea9d0955efc req-247dc67a-a96e-4bef-ba2e-b65abe082583 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030156 May 12 14:42:40.311171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 327/638] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:40.521390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:40.522003 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:40.528123 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:40.528561 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:40.529320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:40.529754 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:40.662643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:40.671863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:40.673355 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:40.674513 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-081ba6d8-d72d-44d5-a361-c2c5e2e9a7cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.157268 May 12 14:42:40.675055 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 312/639] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:40 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:40.736608 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:40.737329 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:40.744350 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:40.744732 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:40.745501 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:40.745939 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:40.887817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:40.896841 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bf4b77cc-0003-4a11-ae3e-32cc9245b0da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1709 microversion: 2.1 time: 0.164504 May 12 14:42:40.897425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 328/640] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:40 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:41.232000 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:41.232667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:41.238756 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:41.239190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:41.239976 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:41.240403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:41.373398 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:41.385920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-53d600ba-8917-4204-8367-66e26891487c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.157660 May 12 14:42:41.386756 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 313/641] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:41 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:41.694179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:41.694800 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:41.701292 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:41.701744 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:41.702492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:41.703139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:41.836529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:41.847927 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:41.849424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:41.850644 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-77862aaa-6fff-4a8a-93d5-2ac155519815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.160701 May 12 14:42:41.851241 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 329/642] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:41 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:41.915249 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:41.916600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:41.923908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:41.924354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:41.925118 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:41.925776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:42.064549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:42.073733 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-54a01df4-1c65-4e64-ae92-66ca5d84a4fc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1713 microversion: 2.1 time: 0.162400 May 12 14:42:42.074310 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 314/643] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:41 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1713 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:42.296102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:42:42.296237 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 14:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:42:42.468704 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:42.469321 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:42.477277 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:42.477725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:42.478510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:42.478998 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:42.620324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:42.627854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-92da2f8a-9a8a-4203-a0c8-61ca43f024e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.219332 May 12 14:42:42.628458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 330/644] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:42 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:42.870458 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:42.871022 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:42.877894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:42.878616 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:42.879868 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:42.880493 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:43.031374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:43.040063 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:43.041862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:43.043979 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-82661f13-57a6-4a49-a01a-62364c25f8b0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.177974 May 12 14:42:43.044797 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 315/645] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:42 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:43.649785 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:43.650813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:43.661716 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:43.662441 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:43.663741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:43.664453 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:43.805158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:43.816209 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-06903f0f-82b4-40bc-b807-8c691b715b66 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.172961 May 12 14:42:43.816802 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 331/646] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:43 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:44.067273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:44.067923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:44.074617 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:44.075062 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:44.075869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:44.076302 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:44.219391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:44.229251 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:44.230827 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:44.232023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2280ce67-5714-456a-8c08-630b35eca7a3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.171551 May 12 14:42:44.232568 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 316/647] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:44 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:44.835791 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:44.836987 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:44.843527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:44.844008 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:44.845013 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:44.845444 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:44.856330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-dc9a3de9-fc66-47fc-b063-a52ac37a5c36 req-b3fdde0e-dd57-4ece-92a1-adc3d1584576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbaf2e7-9702-48d5-8a0e-5088f269f7f1", "name": "network-vif-plugged", "status": "completed", "tag": "b36316ae-0793-416c-9119-9819353b009c"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:44.865755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-dc9a3de9-fc66-47fc-b063-a52ac37a5c36 req-b3fdde0e-dd57-4ece-92a1-adc3d1584576 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:44.866599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-dc9a3de9-fc66-47fc-b063-a52ac37a5c36 req-b3fdde0e-dd57-4ece-92a1-adc3d1584576 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:44.883499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-dc9a3de9-fc66-47fc-b063-a52ac37a5c36 req-b3fdde0e-dd57-4ece-92a1-adc3d1584576 service nova] Creating event network-vif-plugged:b36316ae-0793-416c-9119-9819353b009c for instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 on hv-cinder-84067 May 12 14:42:44.889331 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-dc9a3de9-fc66-47fc-b063-a52ac37a5c36 req-b3fdde0e-dd57-4ece-92a1-adc3d1584576 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036943 May 12 14:42:44.889943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 317/648] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:42:44.980068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:44.992817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9cba46e0-4285-4838-b8ff-1addf536ebeb tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1366 microversion: 2.1 time: 0.160902 May 12 14:42:44.993668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 332/649] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:44 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:45.258402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:45.259553 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:45.266250 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:45.266704 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:45.267485 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:45.267948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:45.410195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:45.418818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:45.420344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:45.421514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-97fffd5d-7924-4a90-9959-4fe2a3e02876 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.171591 May 12 14:42:45.422082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 318/650] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:45 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:46.019578 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:46.020307 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:46.026432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:46.026881 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:46.027645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:46.028102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:46.159103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:46.168687 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-76510178-34a7-47dc-bacd-ffa98dd7b966 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1557 microversion: 2.1 time: 0.153088 May 12 14:42:46.169254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 333/651] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:42:46 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:46.188474 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a00b2b6f-55dd-482d-bdf5-047f9bab26c4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:46.189200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a00b2b6f-55dd-482d-bdf5-047f9bab26c4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:46.196204 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a00b2b6f-55dd-482d-bdf5-047f9bab26c4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:46.196655 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a00b2b6f-55dd-482d-bdf5-047f9bab26c4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:46.197423 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a00b2b6f-55dd-482d-bdf5-047f9bab26c4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:46.197858 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a00b2b6f-55dd-482d-bdf5-047f9bab26c4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:46.285119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a00b2b6f-55dd-482d-bdf5-047f9bab26c4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103181 May 12 14:42:46.286448 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 319/652] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:42:46 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:46.440389 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:46.441108 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:46.448369 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:46.448898 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:46.449743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:46.450246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:46.702088 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:46.713066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:46.714581 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:46.715990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-91b3db5d-67d7-484e-af85-34bd07d06ee6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.279575 May 12 14:42:46.716555 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 334/653] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:46 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:47.734226 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-d34c12f3-a3bd-4b6d-a7fd-4954c22b00fb req-b5417ddc-758f-4f48-80b4-5c31bbbe9c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c58127-4521-4c68-b19f-9a016a0f3aad", "tag": "fb818443-c684-4571-8d0e-1911365e4b6b"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:47.735019 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:47.735616 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:47.743423 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d34c12f3-a3bd-4b6d-a7fd-4954c22b00fb req-b5417ddc-758f-4f48-80b4-5c31bbbe9c69 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:47.743740 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:47.743873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d34c12f3-a3bd-4b6d-a7fd-4954c22b00fb req-b5417ddc-758f-4f48-80b4-5c31bbbe9c69 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:47.744138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:47.744933 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:47.746009 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:47.755818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-d34c12f3-a3bd-4b6d-a7fd-4954c22b00fb req-b5417ddc-758f-4f48-80b4-5c31bbbe9c69 service nova] Creating event network-changed:fb818443-c684-4571-8d0e-1911365e4b6b for instance 42c58127-4521-4c68-b19f-9a016a0f3aad on hv-cinder-84067 May 12 14:42:47.760956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-d34c12f3-a3bd-4b6d-a7fd-4954c22b00fb req-b5417ddc-758f-4f48-80b4-5c31bbbe9c69 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030424 May 12 14:42:47.761566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 320/654] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:47.919262 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:47.929187 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:47.930715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:47.931913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ec54291c-8edb-4668-9fe9-7f41480975fb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.201491 May 12 14:42:47.932758 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 335/655] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:47 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:48.951676 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:48.952436 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:48.959391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:48.959844 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:48.960609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:48.961036 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:49.151561 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:49.161008 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:49.162368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:49.163541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d45a8d29-6423-49b3-9237-f15e60a15ce0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.216701 May 12 14:42:49.164136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 321/656] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:48 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:50.183005 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:50.183571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:50.190234 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:50.190659 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:50.191432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:50.192106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:50.326223 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:50.337060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:50.338553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:50.339730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-532a0dd2-8ca7-4204-a389-e52f95ac7937 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1807 microversion: 2.20 time: 0.160630 May 12 14:42:50.340289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 336/657] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:50 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:51.558776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:51.559363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:51.566228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:51.566681 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:51.567619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:51.568039 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:51.713860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:51.722146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:51.723733 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:51.724890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-54e25773-259f-4447-ba27-3264fb2f8e0b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1794 microversion: 2.20 time: 0.362429 May 12 14:42:51.725449 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 322/658] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:42:51 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1794 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:43:21.560452 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-dc50962a-d403-4da4-b37e-968456ff8a42 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c83ee96-4db5-46c1-9a71-6c5dd05f766c"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:21.561595 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-dc50962a-d403-4da4-b37e-968456ff8a42 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:21.567647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dc50962a-d403-4da4-b37e-968456ff8a42 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:21.568147 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dc50962a-d403-4da4-b37e-968456ff8a42 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:21.568909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dc50962a-d403-4da4-b37e-968456ff8a42 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:21.569340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-dc50962a-d403-4da4-b37e-968456ff8a42 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:21.872454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-dc50962a-d403-4da4-b37e-968456ff8a42 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427753 May 12 14:43:21.873066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 337/659] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:43:21 2022] POST /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:30.506108 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:30.507430 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:30.514831 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:30.515043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:30.515810 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:30.516240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:30.541025 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lazy-loading 'flavor' on Instance uuid 38ea7027-b13e-4308-980a-84c359ae9be3 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:43:30.691849 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-cf7bcaf7-5f93-48df-9974-8ea8aed63cc7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/action" status: 200 len: 32 microversion: 2.1 time: 0.190140 May 12 14:43:30.692410 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 323/660] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:43:30 2022] POST /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:43:30.702681 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:30.703499 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:30.709993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:30.710436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:30.711172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:30.711845 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:30.898070 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:30.906582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a18ed76b-0287-47b8-bfb0-1e3b1ee8c4c0 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.208637 May 12 14:43:30.907165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 338/661] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:30 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:31.929779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:31.930907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:31.942186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.942932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:31.944314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.945106 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:32.100367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:32.109765 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6fe0d272-2871-46cb-88c8-df020af967ac tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.187754 May 12 14:43:32.110392 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 324/662] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:31 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:43:33.131613 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:33.132617 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:33.143765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:33.144512 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:33.145787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:33.146471 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:33.288817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:33.298149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-28bab273-9434-473a-92db-dc4531832a9e tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.173191 May 12 14:43:33.298692 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 339/663] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:33 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:34.317249 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:34.317857 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:34.325694 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:34.326452 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:34.327525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:34.328006 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:34.486836 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:34.496056 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9d0dc1dc-6abf-48b5-bbbe-75fdaf6484b8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.182607 May 12 14:43:34.496630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 325/664] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:34 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:35.514874 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:35.515489 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:35.522285 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.522738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:35.523511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.524002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:35.667054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:35.677871 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2e5aa440-7c17-4b07-a7f5-9ca9de068354 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.167414 May 12 14:43:35.678454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 340/665] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:35 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:36.698491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:36.699472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:36.709468 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:36.710084 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:36.711275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:36.711907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:36.853394 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:36.861810 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fbecb45c-8853-42f3-981d-21c7b0c98b88 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.169529 May 12 14:43:36.862391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 326/666] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:36 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:37.879218 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:37.879908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:37.887097 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:37.887764 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:37.889063 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:37.889728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:38.034735 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:38.043951 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4c8cb872-3c45-48fd-8cd5-13e5e6b54e62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.168639 May 12 14:43:38.044832 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 341/667] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:37 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:39.061434 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:39.062006 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:39.068964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.069412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.070206 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.070650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.203751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:39.215517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-09cd48d3-ff28-4db3-9bd4-0ea69e69e3e5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.158053 May 12 14:43:39.216154 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 327/668] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:39 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:40.238142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:40.239230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:40.249360 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:40.249816 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:40.250584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:40.251017 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:40.402830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:40.411610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e135ace7-c560-4b8d-8879-c889e0ae206c tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.180285 May 12 14:43:40.412216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 342/669] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:40 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:41.430219 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:41.431182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:41.439395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:41.439882 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:41.440645 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:41.441069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:41.604906 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:41.618169 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c099e9e6-a794-4593-a571-587c734b6167 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.192472 May 12 14:43:41.618775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 328/670] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:41 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:42.638904 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:42.639499 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:42.646122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:42.646576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:42.647352 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:42.647810 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:42.789761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:42.799065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6906e905-3d44-4603-bab2-9ede1178d5ef tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.165849 May 12 14:43:42.799661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 343/671] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:42 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:43.819536 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:43.820412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:43.829969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:43.830571 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:43.831627 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:43.832247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:43.966594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:43.978956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-82c423eb-e39b-4c0c-9dd7-7ef658be175a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.164661 May 12 14:43:43.980378 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 329/672] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:43 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:45.009690 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:45.010391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:45.017737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:45.018180 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:45.018940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:45.019363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:45.168445 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:45.177184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8c1e2733-2933-4929-b9bc-8600be75cb38 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.172222 May 12 14:43:45.177780 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 344/673] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:45 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:46.198648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:46.199721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:46.210582 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:46.211316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:46.212640 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:46.213346 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:46.349119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:46.357230 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-804355e4-9f99-48e4-9b72-f550888e82d5 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.165183 May 12 14:43:46.357804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 330/674] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:46 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:47.378014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:47.378678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:47.388540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:47.388993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:47.389740 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:47.390226 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:47.522458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:47.530625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f134ea66-bc7f-41d2-8ad1-4188b6f81c92 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.159481 May 12 14:43:47.531207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 345/675] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:47 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:48.550063 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:48.550708 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:48.557920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:48.558298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:48.559191 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:48.559643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:48.707210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:48.715482 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ef391585-e4d8-472a-89e8-9272880cfef6 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.169664 May 12 14:43:48.716060 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 331/676] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:48 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:49.736926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.737856 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:49.748099 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:49.748543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:49.749313 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:49.749743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:49.890018 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:49.898340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c407f1a7-5a6a-405c-8062-b1e11b5b9755 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.168286 May 12 14:43:49.898916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 346/677] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:49 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:50.916538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:50.917431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:50.924622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:50.925073 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:50.925845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:50.926277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:51.058240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:51.066347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8f0dc5e0-cedf-4238-8dbc-feabd3209d62 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.153799 May 12 14:43:51.067158 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 332/678] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:50 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:52.089327 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:52.089957 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:52.097482 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:52.097932 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:52.098707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:52.099138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:52.244099 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:52.252541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2d3e143e-abd2-45de-afcc-0de41befde32 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.169984 May 12 14:43:52.253128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 347/679] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:52 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:53.274334 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:53.275324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:53.285917 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.286663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.288021 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.288746 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.443045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:53.453594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1ac846e0-a4d7-4c20-8130-fe7720fe4396 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.185936 May 12 14:43:53.454170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 333/680] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:53 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:54.471107 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:54.471741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:54.478657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:54.479110 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:54.480261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:54.480985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:54.640226 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:54.650807 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-73705a2f-50ed-4920-8dc6-6d15f0c01ef8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.184054 May 12 14:43:54.651526 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 348/681] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:54 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:55.673608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:55.674570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:55.685045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:55.685489 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:55.686254 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:55.686682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:55.832617 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:55.841448 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-088f4e84-cc29-42f9-8ece-66d9d9642c80 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.174727 May 12 14:43:55.842030 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 334/682] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:55 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:56.858811 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:56.859394 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:56.866158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:56.866606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:56.867363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:56.867825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:57.002272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:57.010770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-22e965fa-0ba5-4a95-a46a-9234a624d9fa tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1735 microversion: 2.1 time: 0.156070 May 12 14:43:57.011320 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 349/683] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:56 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:58.038962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:58.039984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:58.051574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.052367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.053638 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.054359 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.199832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:58.211359 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2f89ae4e-f0e8-4279-a37f-99a761d35f2a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1715 microversion: 2.1 time: 0.178867 May 12 14:43:58.211987 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 335/684] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:58 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1715 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:58.274606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:58.275522 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:58.283473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.283960 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.284863 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.285305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.375978 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] HTTP exception thrown: Cannot 'detach_volume' instance 38ea7027-b13e-4308-980a-84c359ae9be3 while it is in vm_state rescued May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Request method failure captured: May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: DELETE /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments/7c83ee96-4db5-46c1-9a71-6c5dd05f766c HTTP/1.1 May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu10Vzf4zHwjPGpyGIXEkwrnVyYUCvGapITUAbDEpSLPgnhEGxFy3O4zPcKY_jY0kkY0XRrLfpfxCJVbShjVem8DkRHlfx7b-F-meb1k0RPerFfY4ndsLpBxaiFeHCm8aKMuGOuDL-GtfRL1bZJsBQoFvU0m2_VXmQaUj6bVeLD44s May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:43:58.378399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2580eb79c9684c318adbfaa325e7f12c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 99075fda1c7d4e7698e2062407bc2433 May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:43:58.380144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Cannot 'detach_volume' instance 38ea7027-b13e-4308-980a-84c359ae9be3 while it is in vm_state rescued May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'server_id': '38ea7027-b13e-4308-980a-84c359ae9be3', 'id': '7c83ee96-4db5-46c1-9a71-6c5dd05f766c'} May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38ea7027-b13e-4308-980a-84c359ae9be3 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:58.380823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 38ea7027-b13e-4308-980a-84c359ae9be3 while it is in vm_state rescued May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 38ea7027-b13e-4308-980a-84c359ae9be3 while it is in vm_state rescued May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:43:58.382055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Returning 409 to user: Cannot 'detach_volume' instance 38ea7027-b13e-4308-980a-84c359ae9be3 while it is in vm_state rescued {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:58.383043 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-00f70906-f5da-4394-95f7-72e0c8e4c3a2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "DELETE /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments/7c83ee96-4db5-46c1-9a71-6c5dd05f766c" status: 409 len: 152 microversion: 2.1 time: 0.110284 May 12 14:43:58.383043 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 350/685] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:43:58 2022] DELETE /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments/7c83ee96-4db5-46c1-9a71-6c5dd05f766c => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 14:43:58.390044 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-90a2c3e2-c18c-4cbc-ad9e-55ee54aa6bd7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:58.390499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-90a2c3e2-c18c-4cbc-ad9e-55ee54aa6bd7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:58.397096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90a2c3e2-c18c-4cbc-ad9e-55ee54aa6bd7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.397538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90a2c3e2-c18c-4cbc-ad9e-55ee54aa6bd7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.398290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90a2c3e2-c18c-4cbc-ad9e-55ee54aa6bd7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.398828 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90a2c3e2-c18c-4cbc-ad9e-55ee54aa6bd7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.470992 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-90a2c3e2-c18c-4cbc-ad9e-55ee54aa6bd7 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "POST /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/action" status: 202 len: 0 microversion: 2.1 time: 0.085494 May 12 14:43:58.471629 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 336/686] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:43:58 2022] POST /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:43:58.482868 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:58.483466 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:58.491301 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.491802 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.492578 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.493014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.693104 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:58.704987 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-67e15d5d-0580-469c-96bb-82cb189d6b8d tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1723 microversion: 2.1 time: 0.226232 May 12 14:43:58.706584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 351/687] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:58 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:59.735175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:59.736356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:59.746990 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:59.747438 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:59.748243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:59.748674 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:59.904064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:59.916499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7a26adae-cb9d-4ad3-a475-2a17ea72fa79 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1723 microversion: 2.1 time: 0.189152 May 12 14:43:59.917401 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 337/688] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:43:59 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:00.938075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:00.938825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:00.947046 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:00.947595 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:00.948564 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:00.949062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:01.090605 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:01.099157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6fa52c92-2fad-4409-bf85-ef0877f286fd tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1723 microversion: 2.1 time: 0.166521 May 12 14:44:01.099745 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 352/689] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:00 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:02.122521 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:02.123119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:02.130677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:02.131115 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:02.132061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:02.132486 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:02.263614 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:02.272304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3205d825-221e-4989-976d-3fb6073edcd3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1723 microversion: 2.1 time: 0.153791 May 12 14:44:02.272880 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 338/690] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:02 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:03.295493 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:03.296389 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:03.307506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:03.308397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:03.309612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:03.309973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:03.445121 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:03.457074 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a4f8115e-9e8b-49c1-8d84-3f8160548df9 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1729 microversion: 2.1 time: 0.168386 May 12 14:44:03.457867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 353/691] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:03 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:03.474153 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f62b3b7a-550f-46a9-813d-5e839599282a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:03.474674 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f62b3b7a-550f-46a9-813d-5e839599282a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:03.481660 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f62b3b7a-550f-46a9-813d-5e839599282a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:03.482105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f62b3b7a-550f-46a9-813d-5e839599282a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:03.482908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f62b3b7a-550f-46a9-813d-5e839599282a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:03.483377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f62b3b7a-550f-46a9-813d-5e839599282a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:03.564500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f62b3b7a-550f-46a9-813d-5e839599282a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093860 May 12 14:44:03.565375 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 339/692] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:44:03 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:04.827679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-fda7d1a7-f168-41a1-b8b2-e47cc243fbbd req-53e76b9d-9bf5-497f-a5ad-a5d03fd352e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ea7027-b13e-4308-980a-84c359ae9be3", "tag": "7c19e48a-6576-46c2-b0cc-f53674cec77e"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:04.835729 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-fda7d1a7-f168-41a1-b8b2-e47cc243fbbd req-53e76b9d-9bf5-497f-a5ad-a5d03fd352e6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:04.836172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-fda7d1a7-f168-41a1-b8b2-e47cc243fbbd req-53e76b9d-9bf5-497f-a5ad-a5d03fd352e6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:04.847298 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-fda7d1a7-f168-41a1-b8b2-e47cc243fbbd req-53e76b9d-9bf5-497f-a5ad-a5d03fd352e6 service nova] Creating event network-changed:7c19e48a-6576-46c2-b0cc-f53674cec77e for instance 38ea7027-b13e-4308-980a-84c359ae9be3 on hv-cinder-84067 May 12 14:44:04.852565 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-fda7d1a7-f168-41a1-b8b2-e47cc243fbbd req-53e76b9d-9bf5-497f-a5ad-a5d03fd352e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083226 May 12 14:44:04.853164 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 354/693] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:06.868272 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-51c77f08-1359-44e1-929a-6a1b25dfaf03 req-cd6efccc-8cfa-4c75-9898-0dcc00cd30d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ea7027-b13e-4308-980a-84c359ae9be3", "tag": "7c19e48a-6576-46c2-b0cc-f53674cec77e"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:06.877036 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-51c77f08-1359-44e1-929a-6a1b25dfaf03 req-cd6efccc-8cfa-4c75-9898-0dcc00cd30d0 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:06.877482 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-51c77f08-1359-44e1-929a-6a1b25dfaf03 req-cd6efccc-8cfa-4c75-9898-0dcc00cd30d0 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:06.888966 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-51c77f08-1359-44e1-929a-6a1b25dfaf03 req-cd6efccc-8cfa-4c75-9898-0dcc00cd30d0 service nova] Creating event network-changed:7c19e48a-6576-46c2-b0cc-f53674cec77e for instance 38ea7027-b13e-4308-980a-84c359ae9be3 on hv-cinder-84067 May 12 14:44:06.893997 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-51c77f08-1359-44e1-929a-6a1b25dfaf03 req-cd6efccc-8cfa-4c75-9898-0dcc00cd30d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029947 May 12 14:44:06.894575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 340/694] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:15.449957 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:15.450623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:15.457165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:15.457603 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:15.458359 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:15.458792 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:15.542515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lazy-loading 'services' on Instance uuid f843e0ce-6156-4d75-9341-c049c6297133 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:44:15.627635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-50989e41-5157-4f73-b784-24b1a5856300 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-volume_attachments/b3a31014-9e6f-4d48-aa29-40da72514dce" status: 202 len: 0 microversion: 2.1 time: 0.296450 May 12 14:44:15.628262 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 355/695] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:44:15 2022] DELETE /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-volume_attachments/b3a31014-9e6f-4d48-aa29-40da72514dce => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:17.803891 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2350e003-7483-4422-93d9-3d14f365a1d8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:17.811243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2350e003-7483-4422-93d9-3d14f365a1d8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:17.811711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2350e003-7483-4422-93d9-3d14f365a1d8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:17.836525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2350e003-7483-4422-93d9-3d14f365a1d8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Going to try to stop instance {{(pid=123726) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 14:44:17.887836 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2350e003-7483-4422-93d9-3d14f365a1d8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action" status: 202 len: 0 microversion: 2.1 time: 0.087922 May 12 14:44:17.888425 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 341/696] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:44:17 2022] POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:17.897894 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:17.898577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:17.905196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:17.905655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:17.906430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:17.906827 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:18.052580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:18.060578 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-97b16454-9f63-410e-87dc-521f1f260aea tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.167424 May 12 14:44:18.061129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 356/697] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:17 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:19.080149 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:19.080848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:19.087552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:19.088029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:19.088793 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:19.089223 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:19.225791 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:19.233605 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-92545b78-1b61-4dbf-a105-cb339907864d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.158161 May 12 14:44:19.234176 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 342/698] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:19 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:20.253938 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:20.255222 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:20.264276 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:20.265204 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:20.266217 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:20.266793 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:20.414693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:20.424658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e45bba9c-c06a-4c72-b0a7-656aa860524b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.175900 May 12 14:44:20.425240 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 357/699] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:20 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:21.446955 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:21.447958 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:21.456027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:21.456471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:21.457229 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:21.457657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:21.601778 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:21.610027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1ab030e4-944b-4c6e-b777-755577ce7864 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.169613 May 12 14:44:21.610606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 343/700] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:21 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:22.025227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8eb3f99c-7c83-48b7-8fcf-a99e40517474 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:22.025816 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8eb3f99c-7c83-48b7-8fcf-a99e40517474 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:22.033153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8eb3f99c-7c83-48b7-8fcf-a99e40517474 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.033600 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8eb3f99c-7c83-48b7-8fcf-a99e40517474 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.034373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8eb3f99c-7c83-48b7-8fcf-a99e40517474 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.034807 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8eb3f99c-7c83-48b7-8fcf-a99e40517474 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.063756 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8eb3f99c-7c83-48b7-8fcf-a99e40517474 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments/a156869a-f972-49ad-9bfa-17815bb1713b" status: 200 len: 194 microversion: 2.20 time: 0.042557 May 12 14:44:22.064640 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 358/701] 10.222.0.79 () {60 vars in 1453 bytes} [Thu May 12 14:44:22 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments/a156869a-f972-49ad-9bfa-17815bb1713b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:44:22.131304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:22.132443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:22.138776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.139223 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.140024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.140441 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.267016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'services' on Instance uuid 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:44:22.388507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c131e1ad-3c80-43c1-8890-1c5695d41728 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments/a156869a-f972-49ad-9bfa-17815bb1713b" status: 202 len: 0 microversion: 2.20 time: 0.261112 May 12 14:44:22.389109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 344/702] 10.222.0.79 () {60 vars in 1456 bytes} [Thu May 12 14:44:22 2022] DELETE /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments/a156869a-f972-49ad-9bfa-17815bb1713b => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:44:22.397541 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-50dc3627-4e5a-4d2b-a37d-eca1bc274163 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:22.398525 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-50dc3627-4e5a-4d2b-a37d-eca1bc274163 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:22.405574 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50dc3627-4e5a-4d2b-a37d-eca1bc274163 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.406324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50dc3627-4e5a-4d2b-a37d-eca1bc274163 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.407429 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50dc3627-4e5a-4d2b-a37d-eca1bc274163 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.407823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50dc3627-4e5a-4d2b-a37d-eca1bc274163 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.437731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-50dc3627-4e5a-4d2b-a37d-eca1bc274163 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044092 May 12 14:44:22.438264 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 359/703] 10.222.0.79 () {60 vars in 1342 bytes} [Thu May 12 14:44:22 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:44:22.630156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:22.631217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:22.641443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.642109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.643286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.644009 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.778470 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:22.786247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-601e2808-9616-429a-8839-daaa159a5448 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.162799 May 12 14:44:22.786984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 345/704] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:22 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:23.449588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e715e2d5-8ab2-4ec9-a874-70c4b04d837f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:23.450519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e715e2d5-8ab2-4ec9-a874-70c4b04d837f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:23.457080 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e715e2d5-8ab2-4ec9-a874-70c4b04d837f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:23.457536 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e715e2d5-8ab2-4ec9-a874-70c4b04d837f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:23.458305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e715e2d5-8ab2-4ec9-a874-70c4b04d837f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:23.458736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e715e2d5-8ab2-4ec9-a874-70c4b04d837f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:23.489886 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e715e2d5-8ab2-4ec9-a874-70c4b04d837f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 May 12 14:44:23.490445 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 360/705] 10.222.0.79 () {60 vars in 1342 bytes} [Thu May 12 14:44:23 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:44:23.804169 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:23.804764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:23.811488 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:23.812033 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:23.812804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:23.813236 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:23.953787 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:23.964292 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5ac7f7a7-df92-46d4-aa91-faf716dc79d1 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.163813 May 12 14:44:23.965052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 346/706] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:23 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:24.507074 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d08a4617-5ee9-42ef-b305-4029634499c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:24.508631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d08a4617-5ee9-42ef-b305-4029634499c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:24.519472 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d08a4617-5ee9-42ef-b305-4029634499c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.520275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d08a4617-5ee9-42ef-b305-4029634499c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.521554 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d08a4617-5ee9-42ef-b305-4029634499c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.522284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d08a4617-5ee9-42ef-b305-4029634499c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.554453 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d08a4617-5ee9-42ef-b305-4029634499c1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054562 May 12 14:44:24.555010 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 361/707] 10.222.0.79 () {60 vars in 1342 bytes} [Thu May 12 14:44:24 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:24.616723 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:24.617501 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:24.626297 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.626739 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.627494 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.627990 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.652822 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:44:24.735594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-64736cb0-6d81-4b58-9218-3bc31efa5c35 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 204 len: 0 microversion: 2.20 time: 0.124931 May 12 14:44:24.736241 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 347/708] 10.222.0.79 () {60 vars in 1279 bytes} [Thu May 12 14:44:24 2022] DELETE /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:44:24.745124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:24.745739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:24.752148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.752602 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.753370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.753839 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.888955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:24.897924 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:24.899469 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:24.900678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7a2a3eab-45b5-434a-b07a-27d07a75e58a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.159868 May 12 14:44:24.901246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 362/709] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:24 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:24.983806 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:24.984536 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:24.991233 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.991713 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.992491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.992959 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:25.136789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:25.144479 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e0936413-fedb-41e5-9129-f495a285463b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.165628 May 12 14:44:25.145059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 348/710] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:24 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:25.920007 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:25.920653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:25.927478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:25.927955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:25.928700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:25.929124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:26.075561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:26.084339 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:26.085799 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:26.086995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6b771698-a681-4c60-9123-a58c66663722 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.171510 May 12 14:44:26.087540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 363/711] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:25 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:26.164618 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:26.165526 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:26.175434 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:26.176104 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:26.177201 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:26.177828 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:26.312898 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:26.320363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5cc9a55b-3d86-47e9-9451-eef865d5a7da tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.161355 May 12 14:44:26.320948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 349/712] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:26 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:27.109315 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:27.109877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:27.116632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:27.117072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:27.117831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:27.118254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:27.254144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:27.263543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:27.265906 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:27.267103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0fa3af72-3a71-48d5-b804-9b5c6260b4bd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1722 microversion: 2.20 time: 0.163963 May 12 14:44:27.267664 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 364/713] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:27 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:27.336850 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:27.337426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:27.344426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:27.344872 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:27.345645 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:27.346072 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:27.573336 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:27.581186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b8c2b9ee-faec-486b-97d3-1030ae314eba tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.248190 May 12 14:44:27.582069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 350/714] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:27 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:28.286007 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:28.286616 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:28.294157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.294543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.295310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.295958 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.366900 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:28.369225 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:28.370477 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:28.376620 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:28.378185 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:28.379182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.379774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b701ccb4-ea77-4b8f-9308-e48e3acae4d9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1655 microversion: 2.20 time: 0.097716 May 12 14:44:28.380183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.382576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 365/715] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:28 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:28.383892 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.384485 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.408244 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lazy-loading 'flavor' on Instance uuid 9198b32a-74d2-4298-bed5-be716180d682 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:44:28.526293 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8ee312cd-1dca-45f7-a477-1f314fca2c72 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "POST /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682/action" status: 202 len: 0 microversion: 2.1 time: 0.160733 May 12 14:44:28.550856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 351/716] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:44:28 2022] POST /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:28.551431 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:28.552625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:28.570306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.570995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.572343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.572846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.576012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-bce28b0d-60c2-4890-a077-bd5f64bf6a12 req-ea345cae-5c00-451f-ac28-5b8dfa804857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbaf2e7-9702-48d5-8a0e-5088f269f7f1", "name": "network-vif-deleted", "tag": "b36316ae-0793-416c-9119-9819353b009c"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:28.596600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-bce28b0d-60c2-4890-a077-bd5f64bf6a12 req-ea345cae-5c00-451f-ac28-5b8dfa804857 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.597387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-bce28b0d-60c2-4890-a077-bd5f64bf6a12 req-ea345cae-5c00-451f-ac28-5b8dfa804857 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.638276 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-bce28b0d-60c2-4890-a077-bd5f64bf6a12 req-ea345cae-5c00-451f-ac28-5b8dfa804857 service nova] Creating event network-vif-deleted:b36316ae-0793-416c-9119-9819353b009c for instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 on hv-cinder-84067 May 12 14:44:28.647524 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-bce28b0d-60c2-4890-a077-bd5f64bf6a12 req-ea345cae-5c00-451f-ac28-5b8dfa804857 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095773 May 12 14:44:28.648930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 352/717] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:28.659586 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:28.661146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:28.669354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.669950 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.671555 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.672265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.832877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:28.850288 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e7741a91-c31c-4f2e-bc0c-7cc36f684c05 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.310535 May 12 14:44:28.851646 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 366/718] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:28 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:28.860507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:28.870311 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-28d2c357-f51b-46d3-9730-1b9a9ea94125 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.219439 May 12 14:44:28.871182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 353/719] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:28 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:29.398925 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:29.399615 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:29.407008 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.407459 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.408457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.408905 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.445462 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.446095 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.446706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'fault' on Instance uuid 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:44:29.494247 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:29.505965 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:29.507559 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:29.508861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5707be6b-e051-4171-a1ed-92bc9fcc8814 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 200 len: 1370 microversion: 2.20 time: 0.114158 May 12 14:44:29.509730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 367/720] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:29 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:29.869140 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:29.869692 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:29.876667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.877114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.877890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.878322 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.888362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:29.889302 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:29.895591 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.896054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.896933 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.897342 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:30.077916 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:30.085838 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d3de1163-d988-4805-b6f6-93eb36fb6094 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.220638 May 12 14:44:30.086747 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 354/721] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:29 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:30.094045 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:30.101959 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-58a25825-4517-47eb-9eb4-5825fb377fab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.217497 May 12 14:44:30.102509 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 368/722] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:29 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:30.530179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:30.530970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:30.538576 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:30.539026 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:30.540405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:30.540850 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:30.556503 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] HTTP exception thrown: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Request method failure captured: May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 HTTP/1.1 May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu83aNfYPV8dh6RtPL6o2DKCTRVBkMSKxff94Xdz7iYUpiyalaRdLwoR92YlczE59qMZ1u_FHQEvr_ZhdaIg_k0aZD-oIi0BFztcwApg4J7QecGtyxCLYCv6D4W-KM3J_OvSLALGuZpldAqVSGRH-16INbnORPcvhmUPSpLfbfF2nY May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:44:30.558252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0dd7bf482a7c472bbe4857f2d71d00e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: f7b41d1655e24cf0b1f4bda137115af4 May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:44:30.560120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '1dbaf2e7-9702-48d5-8a0e-5088f269f7f1'} May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:30.560978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:44:30.563012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:44:30.567729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Returning 404 to user: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:30.567729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-533d4fd6-68ec-4399-b12e-106f1c9e7d6c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 404 len: 111 microversion: 2.20 time: 0.035584 May 12 14:44:30.567729 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 355/723] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:30 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:44:30.569584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e5344a1b-a406-4c25-a85e-69fbf43968a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '.version_select at 0x7f4650a9a280>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:30.596670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e5344a1b-a406-4c25-a85e-69fbf43968a6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-773548342" status: 204 len: 0 microversion: 2.20 time: 0.030933 May 12 14:44:30.597268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 369/724] 10.222.0.79 () {60 vars in 1258 bytes} [Thu May 12 14:44:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-773548342 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:44:31.103167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:31.103844 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:31.111572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:31.112109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:31.113085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:31.113626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:31.120253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:31.121144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:31.128634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:31.129139 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:31.129915 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:31.130323 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:31.324739 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:31.332950 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0a9bd1a4-6447-45c1-a9f7-cb4d5c14c451 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.233688 May 12 14:44:31.333544 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 356/725] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:31 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:31.350363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:31.358334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-97f6096e-d5c2-4181-9ca0-2a39808bbfd5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.241732 May 12 14:44:31.359057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 370/726] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:31 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:31.521820 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8412e83b-8e98-4fcf-9864-0103f9ba1b66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'create', calling method: .version_select at 0x7f4650b40af0>, body: {"keypair": {"name": "tempest-keypair-1909760855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFudxpKS/9Obv/uveAaqM4AfWklZImA92UQ6aYpWhSr+oFKjoj0EGIB9fdp8Q6XzSv8bd0+zR1KK7YSdo/5nMJKV5F/g8UfzeeeGvdxGZc8KLZDneRrs69l0+JCut7Iqg=="}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:31.536061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-8412e83b-8e98-4fcf-9864-0103f9ba1b66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:44:31.540046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-8412e83b-8e98-4fcf-9864-0103f9ba1b66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for user f7b41d1655e24cf0b1f4bda137115af4 and project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:44:31.565957 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8412e83b-8e98-4fcf-9864-0103f9ba1b66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047751 May 12 14:44:31.566563 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 357/727] 10.222.0.79 () {62 vars in 1199 bytes} [Thu May 12 14:44:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 14:44:32.350548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:32.351155 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:32.357725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.358276 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.359045 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.359463 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.376631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:32.377995 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:32.388335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.389138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.390279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.390879 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.620822 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:32.629497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-19ba9793-047e-4175-8b96-9e9b99c3f509 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.282862 May 12 14:44:32.630256 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 371/728] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:32 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:32.634038 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:32.642312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8aa84fb2-efac-42df-a1de-b7d115897f72 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1677 microversion: 2.1 time: 0.270777 May 12 14:44:32.642895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 358/729] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:32 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:33.010798 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-404613780", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "272339fb-b619-4ece-94ff-5fe15c567402"}], "security_groups": [{"name": "tempest-securitygroup--1315023476"}], "key_name": "tempest-keypair-1909760855", "user_data": "}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:33.121500 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.network.neutron [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] validate_networks() for [('272339fb-b619-4ece-94ff-5fe15c567402', None, None, None, None, None)] {{(pid=123725) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:44:33.590960 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Flavor limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:44:33.591976 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Image limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:44:33.592689 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Flavor pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:44:33.592829 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Image pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:44:33.593165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:44:33.603728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.604169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.604970 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.605398 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.622911 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:44:33.627127 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Getting quotas for user f7b41d1655e24cf0b1f4bda137115af4 and project 0dd7bf482a7c472bbe4857f2d71d00e1. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:44:33.637765 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Going to run 1 instances... {{(pid=123725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:44:33.640183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:44:33.646914 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:33.647520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:33.654279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.654836 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.656322 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.656749 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.689635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [d815e410-7eb8-4406-86ce-50c5b8e9f720] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:44:33.796672 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:33.808725 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-871cea97-bc82-4b19-ac4c-063aa1510c80 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.165683 May 12 14:44:33.809549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 359/730] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:33 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:33.814764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:33.815368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:33.821297 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.821745 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.822512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.822944 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.958812 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:33.970284 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4f33e94f-b9cd-4f60-ac94-cafdaca0fda0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1654 microversion: 2.1 time: 0.159228 May 12 14:44:33.971110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 360/731] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:33 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:33.991114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-898a4cf2-b31e-4a7d-92ba-a1684fa97080 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:33.997120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-898a4cf2-b31e-4a7d-92ba-a1684fa97080 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.997566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-898a4cf2-b31e-4a7d-92ba-a1684fa97080 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.019323 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-898a4cf2-b31e-4a7d-92ba-a1684fa97080 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Going to try to start instance {{(pid=123726) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 14:44:34.064805 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-898a4cf2-b31e-4a7d-92ba-a1684fa97080 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action" status: 202 len: 0 microversion: 2.1 time: 0.077168 May 12 14:44:34.065402 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 361/732] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:44:33 2022] POST /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:34.073843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:34.074532 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:34.080871 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:34.081311 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.082079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:34.082503 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.230026 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:34.238042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a2822af5-aa67-4cf9-a878-e109f1c976d3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1663 microversion: 2.1 time: 0.168076 May 12 14:44:34.238632 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 362/733] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:34 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:44:34.699025 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [d815e410-7eb8-4406-86ce-50c5b8e9f720] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 58288. May 12 14:44:34.705042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b1734611-429c-4f9f-a042-dfad1de307e9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.698783 May 12 14:44:34.705871 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 372/734] 10.222.0.79 () {62 vars in 1187 bytes} [Thu May 12 14:44:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 14:44:34.716079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fe70ce9f-eb62-4880-bdee-0724afac3b28 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:34.716675 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fe70ce9f-eb62-4880-bdee-0724afac3b28 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:34.796852 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fe70ce9f-eb62-4880-bdee-0724afac3b28 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:34.804641 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fe70ce9f-eb62-4880-bdee-0724afac3b28 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:34.806122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fe70ce9f-eb62-4880-bdee-0724afac3b28 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:34.807221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fe70ce9f-eb62-4880-bdee-0724afac3b28 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1281 microversion: 2.20 time: 0.095044 May 12 14:44:34.807804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 363/735] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:34 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:34.826416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:34.827260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:34.833631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:34.834084 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.834860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:34.835293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.977691 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:34.985649 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fecd229b-7bd3-40e1-9fea-9212d90178c6 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.163245 May 12 14:44:34.986328 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 373/736] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:34 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:35.255925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:35.256462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:35.263519 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:35.264453 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:35.265475 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:35.265918 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:35.402147 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:35.410743 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e165a585-06eb-47cf-ad39-3475ff0664bd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1663 microversion: 2.1 time: 0.158822 May 12 14:44:35.411325 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 364/737] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:35 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:35.826056 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:35.826693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:35.833706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:35.834158 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:35.834963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:35.835400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:35.900483 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:35.910302 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:35.912723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:35.914478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-761638d8-f4d8-447d-8604-9c7323f2790f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1277 microversion: 2.20 time: 0.092329 May 12 14:44:35.915280 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 374/738] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:35 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:36.006554 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:36.007380 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:36.018256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.018984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:36.020310 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.021018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:36.159225 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:36.167084 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0f15500c-48e6-4ea8-a56e-76c1f5a491db tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.166980 May 12 14:44:36.167663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 365/739] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:35 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:36.428688 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:36.429383 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:36.437209 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.437657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:36.438563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.438996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:36.572789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:36.581203 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cfc1f96e-abd3-4047-91c6-6f8df5990c6c tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1667 microversion: 2.1 time: 0.156906 May 12 14:44:36.581780 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 375/740] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:36 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:36.943465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:36.944917 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:36.954483 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.954929 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:36.955724 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.956181 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:37.022112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:37.030534 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:37.032070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:37.033167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-157c7458-d705-430d-9ae5-f302d5905e27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1277 microversion: 2.20 time: 0.096254 May 12 14:44:37.033728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 366/741] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:36 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:37.186258 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:37.186840 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:37.193935 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:37.194386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:37.195150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:37.195611 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:37.329142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:37.336781 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-13c93908-13ca-4f2e-bd20-7ceb18466c0d tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.155465 May 12 14:44:37.337363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 376/742] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:37 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:38.052860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:38.053406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:38.060211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:38.060651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:38.061417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:38.061845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:38.176782 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:38.186646 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:38.188197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:38.189696 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8fdb1774-f571-41ba-9599-c52abf2d7815 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1339 microversion: 2.20 time: 0.140990 May 12 14:44:38.190267 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 367/743] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:38 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1339 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:38.354582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:38.355306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:38.362546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:38.363092 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:38.363903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:38.364346 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:38.843174 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:38.851434 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-eb8254bd-87a9-4eab-beec-d3361b53e332 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.501163 May 12 14:44:38.852047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 377/744] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:38 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:39.208630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:39.209224 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:39.215939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:39.216384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:39.217147 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:39.217575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:39.487562 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:39.496637 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:39.498345 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:39.499590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e44ca694-cc21-45a4-a560-e4b3ee54c244 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.294999 May 12 14:44:39.500558 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 368/745] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:39 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:39.868473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:39.869102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:39.875597 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:39.876084 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:39.876883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:39.877318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:40.098091 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:40.106372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-41d55cae-5883-4a5d-8a63-b3c1571cd7cd tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.241651 May 12 14:44:40.113287 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 378/746] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:39 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:40.250790 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-667383eb-3f81-4ec9-a24a-d3c9632ffcd5 req-187611f8-6c97-459a-ae16-4868451f4841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cf6710-d383-4d92-8328-2812361411a4", "tag": "a6930fb7-573c-4eee-bf16-c9de09bd6eb3"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:40.260107 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-667383eb-3f81-4ec9-a24a-d3c9632ffcd5 req-187611f8-6c97-459a-ae16-4868451f4841 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:40.260715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-667383eb-3f81-4ec9-a24a-d3c9632ffcd5 req-187611f8-6c97-459a-ae16-4868451f4841 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:40.277772 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-667383eb-3f81-4ec9-a24a-d3c9632ffcd5 req-187611f8-6c97-459a-ae16-4868451f4841 service nova] Creating event network-changed:a6930fb7-573c-4eee-bf16-c9de09bd6eb3 for instance 05cf6710-d383-4d92-8328-2812361411a4 on hv-cinder-84067 May 12 14:44:40.283316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-667383eb-3f81-4ec9-a24a-d3c9632ffcd5 req-187611f8-6c97-459a-ae16-4868451f4841 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037328 May 12 14:44:40.284128 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 369/747] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:44:40.518922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:40.519447 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:40.525984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:40.526426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:40.527190 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:40.527612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:40.678943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:40.690734 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:40.693184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:40.694875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-558751a1-efde-402b-83b6-239f86f861cf tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.180228 May 12 14:44:40.695731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 379/748] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:40 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:41.125993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:41.126760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:41.134085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:41.134527 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:41.135286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:41.135728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:41.288095 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:41.296303 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a78c1065-1d4e-4dd6-b22b-287bb1a480a5 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.174961 May 12 14:44:41.304843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 370/749] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:41 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:41.716611 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:41.717253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:41.724110 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:41.724559 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:41.725332 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:41.725762 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:41.895946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:41.903798 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:41.905291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:41.906403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-249848c7-4a2e-408e-963a-c93d95e96e11 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.193829 May 12 14:44:41.906944 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 380/750] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:41 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:42.314643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:42.315386 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:42.322342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.322787 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.323631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.324093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.470883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:42.479394 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-24ebd0ac-67bf-4f1f-bb0f-8249452d87cc tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1571 microversion: 2.1 time: 0.168766 May 12 14:44:42.480022 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 371/751] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:42 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:42.496295 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f40af60e-cf32-4a6e-956e-2bd0b969f841 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:42.496788 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f40af60e-cf32-4a6e-956e-2bd0b969f841 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:42.503082 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f40af60e-cf32-4a6e-956e-2bd0b969f841 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.503510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f40af60e-cf32-4a6e-956e-2bd0b969f841 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.504339 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f40af60e-cf32-4a6e-956e-2bd0b969f841 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.504775 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f40af60e-cf32-4a6e-956e-2bd0b969f841 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.612600 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f40af60e-cf32-4a6e-956e-2bd0b969f841 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "POST /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682/action" status: 202 len: 0 microversion: 2.1 time: 0.120059 May 12 14:44:42.613589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 381/752] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:44:42 2022] POST /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:42.621930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:42.622548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:42.629366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.629845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.630627 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.631089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.771183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:42.778963 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4b15d233-aaf6-4c3b-bcb4-99a5226cc407 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1579 microversion: 2.1 time: 0.160918 May 12 14:44:42.779804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 372/753] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:42 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:42.924785 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:42.925409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:42.931653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.932186 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.932951 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.933373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:43.068334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:43.076563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:43.078022 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:43.079128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-85ae00e5-2977-4cfc-87f5-fda7e498a45b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.158752 May 12 14:44:43.079711 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 382/754] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:42 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:43.800913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:43.801712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:43.809096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:43.809591 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:43.810472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:43.810946 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:43.949580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:43.957727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8b5d57ed-b3e2-4bae-8f02-a8fe66b13b54 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1579 microversion: 2.1 time: 0.163172 May 12 14:44:43.958306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 373/755] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:43 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:44.103600 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:44.104671 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:44.116579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:44.117390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:44.118847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:44.119654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:44.256873 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:44.267715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:44.269647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:44.270810 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bd06f088-d6b3-42d6-acaa-c5479e7c6d67 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.174771 May 12 14:44:44.271411 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 383/756] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:44 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:44.979371 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:44.980491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:44.989857 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:44.990305 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:44.991084 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:44.991500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:45.141874 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:45.150119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6c54ecc9-72f3-4277-ad03-e30cd0865b11 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1579 microversion: 2.1 time: 0.177503 May 12 14:44:45.150695 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 374/757] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:44 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:45.289743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:45.290767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:45.297594 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:45.298044 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:45.298796 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:45.299400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:45.448360 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:45.457258 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:45.458796 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:45.459999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-15bacf96-ba9b-435c-ac9c-5317fd7b4e66 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.174898 May 12 14:44:45.460712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 384/758] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:45 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:45.521895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-0368bbb1-817c-4f53-bbf8-47a62481588c req-471ea46f-ec78-4838-b9d1-9a6cb6c43736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9198b32a-74d2-4298-bed5-be716180d682", "name": "network-vif-unplugged", "status": "completed", "tag": "5e60855e-b1bf-4dc0-8a72-5c0e800298c2"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:45.530247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-0368bbb1-817c-4f53-bbf8-47a62481588c req-471ea46f-ec78-4838-b9d1-9a6cb6c43736 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:45.530866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-0368bbb1-817c-4f53-bbf8-47a62481588c req-471ea46f-ec78-4838-b9d1-9a6cb6c43736 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:45.542567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.compute.server_external_events [req-0368bbb1-817c-4f53-bbf8-47a62481588c req-471ea46f-ec78-4838-b9d1-9a6cb6c43736 service nova] Unable to find a host for instance 9198b32a-74d2-4298-bed5-be716180d682. Dropping event network-vif-unplugged {{(pid=123726) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 14:44:45.543451 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-0368bbb1-817c-4f53-bbf8-47a62481588c req-471ea46f-ec78-4838-b9d1-9a6cb6c43736 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090330 May 12 14:44:45.544080 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 375/759] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 12 14:44:46.169081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:46.169707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:46.176124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.176565 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.177322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.177728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.324965 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:46.334719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-75bc0ab9-b3ff-49a0-9227-b46f7d1fada3 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1521 microversion: 2.1 time: 0.169944 May 12 14:44:46.335535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 385/760] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:46 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:46.482568 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:46.483399 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:46.492427 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.492885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.493768 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.494074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.521921 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-462b4e08-b658-4cf3-a1e2-d462c4eb72da tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:46.522484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-462b4e08-b658-4cf3-a1e2-d462c4eb72da tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:46.538663 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-462b4e08-b658-4cf3-a1e2-d462c4eb72da tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.539138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-462b4e08-b658-4cf3-a1e2-d462c4eb72da tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.539953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-462b4e08-b658-4cf3-a1e2-d462c4eb72da tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.540388 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-462b4e08-b658-4cf3-a1e2-d462c4eb72da tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.575606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-462b4e08-b658-4cf3-a1e2-d462c4eb72da tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad/ips" status: 200 len: 151 microversion: 2.1 time: 0.057763 May 12 14:44:46.576233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 386/761] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:44:46 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:46.591112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "334ececd-84ab-4f6e-921f-2bd68a48f0c6"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:46.592491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:46.602424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.602953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.604134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.604577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.639008 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:46.647068 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:46.648569 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:46.649667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7b92d06b-b1f5-4126-9ded-f944395c1e9e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.173807 May 12 14:44:46.650227 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 376/762] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:46 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:46.684810 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Invalid volume: volume 334ececd-84ab-4f6e-921f-2bd68a48f0c6 is already attached to instances: e98650df-7034-4d31-ad93-f9a133863781 May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: POST /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad/os-volume_attachments HTTP/1.1 May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 74 May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:44:46.686540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {"volumeAttachment": {"volumeId": "334ececd-84ab-4f6e-921f-2bd68a48f0c6"}} May 12 14:44:46.688183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Invalid volume: volume 334ececd-84ab-4f6e-921f-2bd68a48f0c6 is already attached to instances: e98650df-7034-4d31-ad93-f9a133863781 May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'server_id': '42c58127-4521-4c68-b19f-9a016a0f3aad', 'body': {'volumeAttachment': {'volumeId': '334ececd-84ab-4f6e-921f-2bd68a48f0c6'}}} May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 334ececd-84ab-4f6e-921f-2bd68a48f0c6 is already attached to instances: e98650df-7034-4d31-ad93-f9a133863781 May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:46.689055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 334ececd-84ab-4f6e-921f-2bd68a48f0c6 is already attached to instances: e98650df-7034-4d31-ad93-f9a133863781 May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:46.690451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 334ececd-84ab-4f6e-921f-2bd68a48f0c6 is already attached to instances: e98650df-7034-4d31-ad93-f9a133863781 May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 400 to user: Invalid volume: volume 334ececd-84ab-4f6e-921f-2bd68a48f0c6 is already attached to instances: e98650df-7034-4d31-ad93-f9a133863781 {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ac2c914f-c13e-4c69-9092-4222e82550d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105193 May 12 14:44:46.692079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 387/763] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:44:46 2022] POST /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 14:44:46.697806 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:46.698312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:46.704418 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.704866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.705629 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.706110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.730664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:44:46.821247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a5c383bd-4e8a-4c29-90cb-acf176f2e61b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 204 len: 0 microversion: 2.1 time: 0.127070 May 12 14:44:46.821759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 377/764] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:44:46 2022] DELETE /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:44:46.834960 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:46.846038 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:46.847349 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.847875 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.848673 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.849110 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.982710 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:46.992650 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-773b9360-bcfe-4ec6-8ff8-481ef7d4af06 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1682 microversion: 2.1 time: 0.166061 May 12 14:44:46.993260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 388/765] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:46 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:47.357500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:47.358640 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:47.366710 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:47.367155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:47.367959 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:47.368383 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:47.506834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:47.515187 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0d7cb774-c69a-4296-8f53-0cb46a9a6ba4 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.164801 May 12 14:44:47.515802 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 378/766] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:47 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:47.669448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:47.670151 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:47.677970 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:47.678491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:47.679379 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:47.679929 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:47.816310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:47.824377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:47.826072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:47.827193 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-37db11a0-8e65-42f8-8940-8c3285647f20 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.162717 May 12 14:44:47.827777 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 389/767] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:47 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:47.837333 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-8beaf7d7-b204-4afc-a5ae-b1269124f845 req-7116c981-0c6a-477f-977a-681b80fe5f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf6710-d383-4d92-8328-2812361411a4", "name": "network-vif-plugged", "status": "completed", "tag": "a6930fb7-573c-4eee-bf16-c9de09bd6eb3"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:47.845615 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-8beaf7d7-b204-4afc-a5ae-b1269124f845 req-7116c981-0c6a-477f-977a-681b80fe5f4f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:47.846341 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-8beaf7d7-b204-4afc-a5ae-b1269124f845 req-7116c981-0c6a-477f-977a-681b80fe5f4f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:47.857876 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-8beaf7d7-b204-4afc-a5ae-b1269124f845 req-7116c981-0c6a-477f-977a-681b80fe5f4f service nova] Creating event network-vif-plugged:a6930fb7-573c-4eee-bf16-c9de09bd6eb3 for instance 05cf6710-d383-4d92-8328-2812361411a4 on hv-cinder-84067 May 12 14:44:47.862618 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-8beaf7d7-b204-4afc-a5ae-b1269124f845 req-7116c981-0c6a-477f-977a-681b80fe5f4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028913 May 12 14:44:47.863227 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 379/768] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:48.017195 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:48.018196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:48.025333 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.025905 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.026656 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.027085 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.162963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:48.173345 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-aaeed0c6-6891-4200-9a29-7d8289064801 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1682 microversion: 2.1 time: 0.162782 May 12 14:44:48.173889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 390/769] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:48 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:48.537266 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:48.537885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:48.545660 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.546163 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.546961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.547440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.706566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:48.715191 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6e4d7497-21ad-40d5-9191-4800f79947c9 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.185011 May 12 14:44:48.720059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 380/770] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:48 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:48.845452 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:48.846180 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:48.853090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.853527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.854293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.854831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:49.072355 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:49.083547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:49.092299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:49.094124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-41518325-3ea0-498e-88c1-9cc62c7515b1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.252623 May 12 14:44:49.094751 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 391/771] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:48 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:49.190883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:49.191564 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:49.197733 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:49.198189 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:49.198961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:49.199398 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:49.326812 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:49.334630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-205e36f1-1a52-4883-95cd-2d5ec433fba2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1682 microversion: 2.1 time: 0.147691 May 12 14:44:49.335161 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 381/772] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:49 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:49.736816 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:49.737540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:49.744229 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:49.744683 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:49.745446 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:49.745871 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:49.908807 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:49.918341 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-159aacea-9d7b-4556-b4d5-8ebd91a97e3c tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.187968 May 12 14:44:49.918929 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 392/773] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:49 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:50.118500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:50.119546 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:50.129846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:50.130290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:50.131064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:50.131496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:50.281526 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:50.294876 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:50.297202 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:50.298868 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-bcd5e346-227e-4dc6-ad9f-a4ccce66b2e8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.187077 May 12 14:44:50.299682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 382/774] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:50 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:50.358055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:50.358667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:50.365299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:50.365778 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:50.366569 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:50.367002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:50.603724 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:50.611642 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3ed9be3e-3fd2-4fe4-8200-da0d35626058 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1682 microversion: 2.1 time: 0.257458 May 12 14:44:50.612281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 393/775] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:50 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:50.935946 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:50.936559 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:50.943315 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:50.943829 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:50.944617 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:50.945067 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.323306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:51.324699 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:51.331343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.332076 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.333065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.333662 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.357628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:51.367439 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4d05c839-3a2d-4054-b013-4baab6e86651 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.435207 May 12 14:44:51.368874 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 383/776] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:50 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:51.536378 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:51.544936 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:51.546426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:51.547535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c23eb169-2aaa-41f4-9ce2-206028c7207f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1407 microversion: 2.20 time: 0.228847 May 12 14:44:51.548138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 394/777] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:51 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:51.629738 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:51.630633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:51.639458 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.640679 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.641462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.641931 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.714472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:51.722168 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d29e43a8-f6c6-466e-82ff-55ab2ab7337f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1615 microversion: 2.1 time: 0.096612 May 12 14:44:51.722385 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 384/778] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:51 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:51.950734 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-96403ba9-ffc3-4b74-b9d7-c1d280011712 req-90d32dd9-9bf9-4197-a5e8-4266895d40ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c58127-4521-4c68-b19f-9a016a0f3aad", "name": "network-vif-deleted", "tag": "fb818443-c684-4571-8d0e-1911365e4b6b"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:51.965789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-96403ba9-ffc3-4b74-b9d7-c1d280011712 req-90d32dd9-9bf9-4197-a5e8-4266895d40ad service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.966503 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-96403ba9-ffc3-4b74-b9d7-c1d280011712 req-90d32dd9-9bf9-4197-a5e8-4266895d40ad service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.981045 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-96403ba9-ffc3-4b74-b9d7-c1d280011712 req-90d32dd9-9bf9-4197-a5e8-4266895d40ad service nova] Creating event network-vif-deleted:fb818443-c684-4571-8d0e-1911365e4b6b for instance 42c58127-4521-4c68-b19f-9a016a0f3aad on hv-cinder-84067 May 12 14:44:51.988122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-96403ba9-ffc3-4b74-b9d7-c1d280011712 req-90d32dd9-9bf9-4197-a5e8-4266895d40ad service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040725 May 12 14:44:51.988770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 395/779] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:52.386120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:52.386822 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:52.393342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.394451 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.395245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.395696 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.532629 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:52.540279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6ef1b8e7-0760-49d3-a7b3-95e2b45f82ed tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.158541 May 12 14:44:52.541248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 385/780] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:52 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:52.569535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:52.570931 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:52.592660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.593032 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.594005 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.594432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.737060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:52.738727 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:52.739403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:52.745931 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.746453 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.747291 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.747825 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.748318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:52.749860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:52.751028 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-192fc63c-2d5e-41cb-a15e-0bb409618840 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1599 microversion: 2.20 time: 0.187024 May 12 14:44:52.751601 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 396/781] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:44:52 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:44:52.769331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0e81b17a-0d5f-4ce3-b560-4d7a8dcce52c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:52.769936 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0e81b17a-0d5f-4ce3-b560-4d7a8dcce52c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:52.779844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e81b17a-0d5f-4ce3-b560-4d7a8dcce52c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.780290 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e81b17a-0d5f-4ce3-b560-4d7a8dcce52c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.781105 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e81b17a-0d5f-4ce3-b560-4d7a8dcce52c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.781563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e81b17a-0d5f-4ce3-b560-4d7a8dcce52c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.787258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.787958 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.788548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lazy-loading 'fault' on Instance uuid 42c58127-4521-4c68-b19f-9a016a0f3aad {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:44:52.839645 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:52.851226 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ed0d2686-5bf0-4613-b552-d923d3e403b3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 200 len: 1331 microversion: 2.1 time: 0.116495 May 12 14:44:52.852077 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 386/782] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:52 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:52.884562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0e81b17a-0d5f-4ce3-b560-4d7a8dcce52c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.119621 May 12 14:44:52.885212 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 397/783] 10.222.0.79 () {60 vars in 1315 bytes} [Thu May 12 14:44:52 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:44:53.558222 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:53.558902 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:53.565517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:53.566123 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:53.567944 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:53.568350 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:53.805498 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:53.813786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4eabb681-0dfa-4b76-ac0e-1d1d091c7b07 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.259434 May 12 14:44:53.814495 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 387/784] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:53 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:53.869508 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:53.870108 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:53.876555 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:53.877005 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:53.877822 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:53.878310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:53.891652 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad HTTP/1.1 May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:44:53.893363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:44:53.895456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '42c58127-4521-4c68-b19f-9a016a0f3aad'} May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:53.896249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:44:53.897456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:44:53.898546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:53.898546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3219c851-4847-48cd-8990-388a35be856e tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 404 len: 111 microversion: 2.1 time: 0.029842 May 12 14:44:53.898546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 398/785] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:53 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:44:53.903921 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3aa87b1d-bd47-4576-b1da-6e4fda8d7ea9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '.version_select at 0x7f46509af430>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:53.924282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3aa87b1d-bd47-4576-b1da-6e4fda8d7ea9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592418548" status: 202 len: 0 microversion: 2.1 time: 0.024051 May 12 14:44:53.924843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 388/786] 10.222.0.79 () {58 vars in 1217 bytes} [Thu May 12 14:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592418548 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:54.028632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-5395b4cc-5694-4e91-bc81-62b2a9f03a9f req-6794fe3b-047a-4da0-a16d-78f95a060181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cf6710-d383-4d92-8328-2812361411a4", "tag": "a6930fb7-573c-4eee-bf16-c9de09bd6eb3"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:54.037984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-5395b4cc-5694-4e91-bc81-62b2a9f03a9f req-6794fe3b-047a-4da0-a16d-78f95a060181 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:54.038532 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-5395b4cc-5694-4e91-bc81-62b2a9f03a9f req-6794fe3b-047a-4da0-a16d-78f95a060181 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:54.051123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-5395b4cc-5694-4e91-bc81-62b2a9f03a9f req-6794fe3b-047a-4da0-a16d-78f95a060181 service nova] Creating event network-changed:a6930fb7-573c-4eee-bf16-c9de09bd6eb3 for instance 05cf6710-d383-4d92-8328-2812361411a4 on hv-cinder-84067 May 12 14:44:54.056148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-5395b4cc-5694-4e91-bc81-62b2a9f03a9f req-6794fe3b-047a-4da0-a16d-78f95a060181 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031103 May 12 14:44:54.056749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 399/787] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:54.682232 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:54.683319 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:54.690114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:54.690771 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:54.691542 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:54.691992 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:54.772605 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lazy-loading 'services' on Instance uuid e98650df-7034-4d31-ad93-f9a133863781 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:44:54.831479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:54.832623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:54.844437 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:54.844899 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:54.845941 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:54.846483 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:54.856492 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-751edecf-415c-4884-b0a9-994965bed3d5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments/334ececd-84ab-4f6e-921f-2bd68a48f0c6" status: 202 len: 0 microversion: 2.1 time: 0.178558 May 12 14:44:54.857097 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 389/788] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:44:54 2022] DELETE /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments/334ececd-84ab-4f6e-921f-2bd68a48f0c6 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:54.866332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a526d0c1-4db5-4280-94bf-d44fdd8a2433 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:54.867500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a526d0c1-4db5-4280-94bf-d44fdd8a2433 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:54.873790 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a526d0c1-4db5-4280-94bf-d44fdd8a2433 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:54.874472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a526d0c1-4db5-4280-94bf-d44fdd8a2433 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:54.875262 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a526d0c1-4db5-4280-94bf-d44fdd8a2433 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:54.875723 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a526d0c1-4db5-4280-94bf-d44fdd8a2433 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:54.907343 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a526d0c1-4db5-4280-94bf-d44fdd8a2433 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 May 12 14:44:54.908026 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 390/789] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:44:54 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:44:54.994914 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:55.004439 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2cd672d1-d442-49d7-9138-665fc47bb0ef tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.176271 May 12 14:44:55.005010 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 400/790] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:54 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:44:55.919306 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5bfa7803-25c1-45ed-9dee-9c7256872728 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:55.920294 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5bfa7803-25c1-45ed-9dee-9c7256872728 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:55.927712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5bfa7803-25c1-45ed-9dee-9c7256872728 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:55.928174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5bfa7803-25c1-45ed-9dee-9c7256872728 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:55.928948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5bfa7803-25c1-45ed-9dee-9c7256872728 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:55.929384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5bfa7803-25c1-45ed-9dee-9c7256872728 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:55.959709 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5bfa7803-25c1-45ed-9dee-9c7256872728 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 May 12 14:44:55.960296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 391/791] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:44:55 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:44:56.025002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:56.025928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:56.035975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:56.036433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:56.037205 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:56.037649 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:56.180334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:56.188147 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8bf94315-0c47-46cd-9d82-1635064b09c7 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.169176 May 12 14:44:56.188691 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 401/792] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:56 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:56.977688 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0c8f0a0e-67cf-4b00-aee8-d0cfec1b2915 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:56.979239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0c8f0a0e-67cf-4b00-aee8-d0cfec1b2915 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:56.989745 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c8f0a0e-67cf-4b00-aee8-d0cfec1b2915 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:56.990196 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c8f0a0e-67cf-4b00-aee8-d0cfec1b2915 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:56.990970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c8f0a0e-67cf-4b00-aee8-d0cfec1b2915 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:56.991405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c8f0a0e-67cf-4b00-aee8-d0cfec1b2915 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:57.021106 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0c8f0a0e-67cf-4b00-aee8-d0cfec1b2915 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051258 May 12 14:44:57.021673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 392/793] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:44:56 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:44:57.083363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:57.083884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:57.090282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:57.090714 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:57.091466 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:57.091921 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:57.118452 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:44:57.206257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-65e87e55-fa03-4a14-8b68-c105db64c611 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 204 len: 0 microversion: 2.1 time: 0.126863 May 12 14:44:57.206509 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:57.206859 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 402/794] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:44:57 2022] DELETE /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:44:57.206999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:57.213847 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:57.214347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:57.215549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:57.215860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:57.216010 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:57.216578 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:57.223044 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:57.223496 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:57.224307 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:57.224747 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:57.414295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:57.419764 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:57.425704 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a4f630ac-48ab-4f42-bd3e-c3bdbb971cdb tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.224146 May 12 14:44:57.426444 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 393/795] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:57 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:44:57.429865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e3fd2f25-aebb-475a-b76c-de55448f83a3 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1681 microversion: 2.1 time: 0.218388 May 12 14:44:57.430536 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 403/796] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:57 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:44:58.444408 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:58.444992 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:58.450022 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:58.450607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:58.453400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:58.453829 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:58.454631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:58.455059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:58.460758 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:58.461230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:58.462519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:58.462951 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:58.658497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:58.667470 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-46a95a9a-ad0f-4baa-be08-0bb836b6c22e tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.227423 May 12 14:44:58.668061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 394/797] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:58 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:58.672070 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:58.680525 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-95ba7634-cabf-4e3a-b777-9269402444ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1681 microversion: 2.1 time: 0.235528 May 12 14:44:58.681144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 404/798] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:58 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:59.689301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:59.690079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:59.697431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:59.697882 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:59.698377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:59.698839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:59.698997 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:59.699159 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:59.705706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:59.706367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:59.707196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:59.707635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:00.260177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:00.267555 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:00.267773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f746c070-898d-4c0a-bda3-4e300c495978 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1681 microversion: 2.1 time: 0.573123 May 12 14:45:00.275966 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1d9f7006-fdc4-41b2-906c-482b62ddf28f tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.593188 May 12 14:45:00.276549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 395/799] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:59 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:00.278169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 405/800] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:44:59 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1681 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:00.998768 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-d9ae7eff-6907-422b-9b35-072b8fbf1ee3 req-3725460b-f002-4184-9537-7290eea089d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98650df-7034-4d31-ad93-f9a133863781", "name": "network-vif-deleted", "tag": "cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:01.007761 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d9ae7eff-6907-422b-9b35-072b8fbf1ee3 req-3725460b-f002-4184-9537-7290eea089d7 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.008162 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d9ae7eff-6907-422b-9b35-072b8fbf1ee3 req-3725460b-f002-4184-9537-7290eea089d7 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.019589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-d9ae7eff-6907-422b-9b35-072b8fbf1ee3 req-3725460b-f002-4184-9537-7290eea089d7 service nova] Creating event network-vif-deleted:cfd4aa62-c41a-4ab8-926f-361dc6fb8cd0 for instance e98650df-7034-4d31-ad93-f9a133863781 on hv-cinder-84067 May 12 14:45:01.024513 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-d9ae7eff-6907-422b-9b35-072b8fbf1ee3 req-3725460b-f002-4184-9537-7290eea089d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029402 May 12 14:45:01.025077 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 396/801] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:01.286805 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:01.287422 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:01.294038 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:01.294462 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.294739 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:01.294909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.295908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.296351 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.301584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.303165 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.304185 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.304789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.331459 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.331723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.332355 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lazy-loading 'fault' on Instance uuid e98650df-7034-4d31-ad93-f9a133863781 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:45:01.399347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:01.406917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5de91b1d-8a66-47d5-a412-da6f8f02df7d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 200 len: 1330 microversion: 2.1 time: 0.124774 May 12 14:45:01.407566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 406/802] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:01 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:01.467657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:01.475403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-62d6d7c8-c964-40dd-9659-e322548f3487 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.185952 May 12 14:45:01.476058 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 397/803] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:01 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:02.046091 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-bac8e18d-1102-411a-86f5-90c7c05093b3 req-b4963d06-984a-4291-abdb-8f63e485e7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9198b32a-74d2-4298-bed5-be716180d682", "name": "network-vif-plugged", "status": "completed", "tag": "5e60855e-b1bf-4dc0-8a72-5c0e800298c2"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:02.054506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-bac8e18d-1102-411a-86f5-90c7c05093b3 req-b4963d06-984a-4291-abdb-8f63e485e7dd service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:02.055186 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-bac8e18d-1102-411a-86f5-90c7c05093b3 req-b4963d06-984a-4291-abdb-8f63e485e7dd service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:02.068057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-bac8e18d-1102-411a-86f5-90c7c05093b3 req-b4963d06-984a-4291-abdb-8f63e485e7dd service nova] Creating event network-vif-plugged:5e60855e-b1bf-4dc0-8a72-5c0e800298c2 for instance 9198b32a-74d2-4298-bed5-be716180d682 on hv-cinder-84067 May 12 14:45:02.073068 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-bac8e18d-1102-411a-86f5-90c7c05093b3 req-b4963d06-984a-4291-abdb-8f63e485e7dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030706 May 12 14:45:02.073734 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 407/804] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:02.426347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:02.427063 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:02.433525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:02.433989 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:02.434719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:02.435146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:02.450207 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 HTTP/1.1 May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:45:02.451862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:45:02.453358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'e98650df-7034-4d31-ad93-f9a133863781'} May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:45:02.454599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:45:02.455953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:02.457289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:45:02.457289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-355a4c38-4b11-4ddb-9d56-a91b1412e4de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 404 len: 111 microversion: 2.1 time: 0.031306 May 12 14:45:02.457289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 398/805] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:02 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:45:02.463678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-de06cff6-fab7-4a70-a210-1aea195d01be tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '.version_select at 0x7f4650a8cf70>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:02.484292 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-de06cff6-fab7-4a70-a210-1aea195d01be tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36731124" status: 202 len: 0 microversion: 2.1 time: 0.024788 May 12 14:45:02.485473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 408/806] 10.222.0.79 () {58 vars in 1214 bytes} [Thu May 12 14:45:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36731124 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:45:02.494897 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:02.495889 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:02.503274 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:02.504250 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:02.505189 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:02.505466 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:02.648089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:02.661018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c6167125-c29a-4130-8b4c-20f490fb0cc1 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.172145 May 12 14:45:02.662042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 399/807] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:02 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:03.163995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e0b73749-f5de-46ad-a6c8-cee0cb8b72fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: .version_select at 0x7f4650a70670>, body: {"keypair": {"name": "tempest-keypair-757280015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXRvkr4WEqoX0Qo4t2Tjitz1mGK44isrjb4krQwFNBgZmD1akJy3pVBLQoscs1nTUHEMRU31dt9cAJogvx9fNoePXw5zE4RjvSpb0NbvrIZKCYr0/fj7d7J8B489KW8Sg=="}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:03.179478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-e0b73749-f5de-46ad-a6c8-cee0cb8b72fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:45:03.183482 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-e0b73749-f5de-46ad-a6c8-cee0cb8b72fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:45:03.208728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e0b73749-f5de-46ad-a6c8-cee0cb8b72fe tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048792 May 12 14:45:03.209485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 409/808] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:45:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:03.678795 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:03.679704 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:03.686228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:03.686673 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:03.687432 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:03.688115 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:03.902907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:03.911936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-027e21b2-5811-40cd-b128-ed103dbfd486 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1577 microversion: 2.1 time: 0.237204 May 12 14:45:03.913527 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 400/809] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:03 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:04.656270 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1071633240", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d1d321-0090-41ca-9dd0-9f717585a523"}], "security_groups": [{"name": "tempest-securitygroup--1944667367"}], "key_name": "tempest-keypair-757280015", "user_data": "}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:04.759057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.network.neutron [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] validate_networks() for [('45d1d321-0090-41ca-9dd0-9f717585a523', None, None, None, None, None)] {{(pid=123725) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:45:04.930096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:04.930693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:04.937213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:04.937789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:04.938639 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:04.939072 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:05.147214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:05.154973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-85ec39fc-6ae6-425e-a1a9-c1948df49c4a tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1564 microversion: 2.1 time: 0.228836 May 12 14:45:05.155566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 401/810] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:04 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:05.222968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:45:05.223388 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:45:05.223897 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:45:05.224304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:45:05.224707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:45:05.234669 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:05.235108 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:05.235943 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:05.236371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:05.253381 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:45:05.257372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:45:05.268326 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Going to run 1 instances... {{(pid=123725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:45:05.270692 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:45:05.319888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fdeb1f98-2e42-444c-ae6c-0eafcebd5fe0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.668271 May 12 14:45:05.320538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 410/811] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:45:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:45:05.331102 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-20cec4dc-129f-4307-a1e0-03d4495d3e64 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:05.331742 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-20cec4dc-129f-4307-a1e0-03d4495d3e64 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:05.388138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-20cec4dc-129f-4307-a1e0-03d4495d3e64 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:05.395363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-20cec4dc-129f-4307-a1e0-03d4495d3e64 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1241 microversion: 2.1 time: 0.068362 May 12 14:45:05.396023 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 402/812] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:05 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:06.414879 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:06.415533 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:06.423887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:06.424472 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:06.425373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:06.425880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:06.494658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:06.502146 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0a236f37-f407-40eb-8af5-be2ba2a8f78d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1293 microversion: 2.1 time: 0.092629 May 12 14:45:06.502870 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 411/813] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:06 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:07.519890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:07.521234 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:07.528258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:07.528735 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:07.529445 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:07.529863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:07.739208 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:07.747214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-252110f1-1d93-4bcc-9323-46f1fd8bf2e4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.231565 May 12 14:45:07.748069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 403/814] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:07 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:08.280645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-12846c43-4213-4480-8802-5babe8b15c30 req-af76746e-c43e-4e17-8280-b3baede36665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e", "tag": "44d83aed-57c0-4861-9b6d-8063bb15977b"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:08.290629 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-12846c43-4213-4480-8802-5babe8b15c30 req-af76746e-c43e-4e17-8280-b3baede36665 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:08.291154 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-12846c43-4213-4480-8802-5babe8b15c30 req-af76746e-c43e-4e17-8280-b3baede36665 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:08.306991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-12846c43-4213-4480-8802-5babe8b15c30 req-af76746e-c43e-4e17-8280-b3baede36665 service nova] Creating event network-changed:44d83aed-57c0-4861-9b6d-8063bb15977b for instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e on hv-cinder-84067 May 12 14:45:08.313360 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-12846c43-4213-4480-8802-5babe8b15c30 req-af76746e-c43e-4e17-8280-b3baede36665 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036443 May 12 14:45:08.314236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 412/815] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:08.765113 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:08.765721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:08.772944 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:08.773383 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:08.774182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:08.774607 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:08.913994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:08.921825 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7791b102-9115-4fd0-bd02-3a8fec729973 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.160595 May 12 14:45:08.922377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 404/816] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:08 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:09.950369 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:09.951455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:09.960101 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:09.960548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:09.961307 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:09.961739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:10.091514 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:10.100862 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ce94f6c8-87fb-4e5e-8ee1-025e77ef4b36 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.157852 May 12 14:45:10.101437 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 413/817] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:09 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:11.122519 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:11.123511 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:11.131967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.132409 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.133171 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.133594 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.278169 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:11.286235 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ad2ac489-47ca-4a1a-aeb9-8db0b38be50f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.170068 May 12 14:45:11.286816 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 405/818] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:11 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:11.321004 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:11.321538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:11.328064 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.328517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.329291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.329753 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.411222 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lazy-loading 'services' on Instance uuid 38ea7027-b13e-4308-980a-84c359ae9be3 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:45:11.497196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7b6451e3-316c-482f-a5bf-5cdb553f6c0b tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "DELETE /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments/7c83ee96-4db5-46c1-9a71-6c5dd05f766c" status: 202 len: 0 microversion: 2.1 time: 0.179900 May 12 14:45:11.497800 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 414/819] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:45:11 2022] DELETE /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments/7c83ee96-4db5-46c1-9a71-6c5dd05f766c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:45:11.509824 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e0457688-7f55-4fd2-aa5d-b0308c7d46b3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:11.510827 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e0457688-7f55-4fd2-aa5d-b0308c7d46b3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:11.519054 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0457688-7f55-4fd2-aa5d-b0308c7d46b3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.519505 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0457688-7f55-4fd2-aa5d-b0308c7d46b3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.520344 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0457688-7f55-4fd2-aa5d-b0308c7d46b3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.520781 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e0457688-7f55-4fd2-aa5d-b0308c7d46b3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.552612 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e0457688-7f55-4fd2-aa5d-b0308c7d46b3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049827 May 12 14:45:11.553195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 406/820] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:45:11 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:12.304825 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:12.305442 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:12.312767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:12.313226 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:12.314072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:12.314511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:12.566166 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-72d46f19-ba83-461e-916f-54d6b8fe4182 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:12.567082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-72d46f19-ba83-461e-916f-54d6b8fe4182 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:12.573708 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-72d46f19-ba83-461e-916f-54d6b8fe4182 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:12.574188 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-72d46f19-ba83-461e-916f-54d6b8fe4182 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:12.574969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-72d46f19-ba83-461e-916f-54d6b8fe4182 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:12.575403 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-72d46f19-ba83-461e-916f-54d6b8fe4182 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:12.606215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-72d46f19-ba83-461e-916f-54d6b8fe4182 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 May 12 14:45:12.606808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 407/821] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:45:12 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:12.707029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:12.714707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-425c0ae6-bca4-408f-b4ee-29848ca31123 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.414254 May 12 14:45:12.715263 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 415/822] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:12 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:13.621174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8c11433c-7044-4d4f-a5b8-edff7539f522 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:13.622537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8c11433c-7044-4d4f-a5b8-edff7539f522 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:13.633179 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c11433c-7044-4d4f-a5b8-edff7539f522 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.633808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c11433c-7044-4d4f-a5b8-edff7539f522 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.634982 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c11433c-7044-4d4f-a5b8-edff7539f522 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.635613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8c11433c-7044-4d4f-a5b8-edff7539f522 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.667357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8c11433c-7044-4d4f-a5b8-edff7539f522 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052916 May 12 14:45:13.667953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 408/823] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:45:13 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:45:13.732553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:13.733148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:13.740436 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.740872 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.741837 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.742276 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.745318 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:13.745803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:13.751878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.752361 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.753133 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.753569 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.778175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:45:13.860314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-43452f28-a5f1-4037-921f-16311c4e5b90 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "DELETE /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 204 len: 0 microversion: 2.1 time: 0.118586 May 12 14:45:13.860924 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 409/824] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:45:13 2022] DELETE /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:45:13.869808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:13.870607 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:13.876701 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.877410 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.877964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:13.878390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:13.885723 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:13.893361 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a7bfaed3-363c-403a-9167-872437896421 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.164559 May 12 14:45:13.894250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 416/825] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:13 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:14.015194 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:14.027353 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7fe042fd-9f81-4ddc-b40d-1154e703b8e2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1689 microversion: 2.1 time: 0.161529 May 12 14:45:14.028298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 410/826] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:13 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:14.228047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-1816eb69-eb41-4a89-a054-8da9aa4fd000 req-6c044494-d5a1-4c9c-af2c-bfa78c9dec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e", "name": "network-vif-plugged", "status": "completed", "tag": "44d83aed-57c0-4861-9b6d-8063bb15977b"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:14.239564 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-1816eb69-eb41-4a89-a054-8da9aa4fd000 req-6c044494-d5a1-4c9c-af2c-bfa78c9dec5c service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:14.240063 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-1816eb69-eb41-4a89-a054-8da9aa4fd000 req-6c044494-d5a1-4c9c-af2c-bfa78c9dec5c service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:14.251801 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-1816eb69-eb41-4a89-a054-8da9aa4fd000 req-6c044494-d5a1-4c9c-af2c-bfa78c9dec5c service nova] Creating event network-vif-plugged:44d83aed-57c0-4861-9b6d-8063bb15977b for instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e on hv-cinder-84067 May 12 14:45:14.256842 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-1816eb69-eb41-4a89-a054-8da9aa4fd000 req-6c044494-d5a1-4c9c-af2c-bfa78c9dec5c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 May 12 14:45:14.257445 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 417/827] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:14.911079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:14.911611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:14.918778 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:14.919240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:14.919999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:14.920423 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:15.045998 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:15.046647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:15.053712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:15.054152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:15.054922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:15.055348 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:15.066324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:15.074196 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-93ee8a7d-bb1c-450a-937d-239e815297c5 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.167207 May 12 14:45:15.074802 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 411/828] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:14 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:15.202370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:15.210847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a7bea19c-348a-405e-a58a-15e610cbcf04 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1689 microversion: 2.1 time: 0.169969 May 12 14:45:15.211430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 418/829] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:15 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:16.096212 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:16.097197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:16.104414 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:16.104860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:16.105622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:16.106053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:16.228401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:16.229004 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:16.235524 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:16.235990 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:16.236757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:16.237181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:16.246575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:16.254575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ed40b2be-7113-4e7d-8782-70b82b9b410c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.164927 May 12 14:45:16.255170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 412/830] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:16 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:16.367562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:16.375396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9cb7545c-2993-4eee-b38b-3abfbc939535 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1689 microversion: 2.1 time: 0.150914 May 12 14:45:16.376020 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 419/831] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:16 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:17.277406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:17.278367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:17.290391 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:17.291132 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:17.292862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:17.293636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:17.392717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:17.393306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:17.400151 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:17.400599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:17.401373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:17.401807 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:17.428516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:17.436278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c3f70de3-f102-406a-9387-01cfcd356bd7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.166990 May 12 14:45:17.436952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 413/832] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:17 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:17.534697 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:17.546925 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7eb6b442-0efb-4689-8b61-abb4e3aa57a3 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1689 microversion: 2.1 time: 0.157971 May 12 14:45:17.547796 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 420/833] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:17 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:18.458115 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:18.459134 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:18.469749 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:18.470305 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:18.471349 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:18.471988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:18.566378 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:18.567300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:18.573922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:18.574369 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:18.575142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:18.575575 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:18.625215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:18.633757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5b1a69b3-9a23-42a7-b545-cd11d7d73418 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.182827 May 12 14:45:18.634437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 414/834] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:18 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:18.721968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:18.734096 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-860366ec-ddec-4f15-b205-5cfd9a418d24 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1689 microversion: 2.1 time: 0.171384 May 12 14:45:18.735063 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 421/835] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:18 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:19.650484 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:19.651093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:19.657984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:19.658427 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:19.659193 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:19.659628 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:19.751743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:19.752346 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:19.759437 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:19.759922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:19.760696 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:19.761125 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:19.936962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:19.947197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d5b3f4eb-2c0c-479b-accc-a54588481a5c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1367 microversion: 2.1 time: 0.300599 May 12 14:45:19.948020 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 415/836] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:19 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:20.020719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:20.028544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d3a8dd96-039c-4b14-932d-506c5ed18ff2 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1689 microversion: 2.1 time: 0.280711 May 12 14:45:20.029132 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 422/837] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:19 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1689 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:20.621598 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-4fe4fe25-76be-419f-8617-89d241c30e16 req-cbbcf56a-353c-45ee-8389-883e90e90831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ea7027-b13e-4308-980a-84c359ae9be3", "name": "network-vif-deleted", "tag": "7c19e48a-6576-46c2-b0cc-f53674cec77e"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:20.630090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-4fe4fe25-76be-419f-8617-89d241c30e16 req-cbbcf56a-353c-45ee-8389-883e90e90831 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:20.630775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-4fe4fe25-76be-419f-8617-89d241c30e16 req-cbbcf56a-353c-45ee-8389-883e90e90831 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:20.642671 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-4fe4fe25-76be-419f-8617-89d241c30e16 req-cbbcf56a-353c-45ee-8389-883e90e90831 service nova] Creating event network-vif-deleted:7c19e48a-6576-46c2-b0cc-f53674cec77e for instance 38ea7027-b13e-4308-980a-84c359ae9be3 on hv-cinder-84067 May 12 14:45:20.650577 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-4fe4fe25-76be-419f-8617-89d241c30e16 req-cbbcf56a-353c-45ee-8389-883e90e90831 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032542 May 12 14:45:20.652284 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 416/838] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:20.964656 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:20.965218 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:20.972046 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:20.972512 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:20.973272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:20.973706 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.046165 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:21.046860 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:21.053916 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.054367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.055152 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.055580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.088477 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.088897 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.089292 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lazy-loading 'fault' on Instance uuid 38ea7027-b13e-4308-980a-84c359ae9be3 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:45:21.121134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:21.129646 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-be19d68b-4c88-4586-b227-3158ed1c195d tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1557 microversion: 2.1 time: 0.168736 May 12 14:45:21.130732 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 423/839] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:20 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:21.138703 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:21.146731 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6ebec52b-15f4-45d3-915d-cab672fdbac4 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 200 len: 1336 microversion: 2.1 time: 0.105156 May 12 14:45:21.147830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-080d8c4d-d4ed-4893-910a-a5f5aa267762 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:21.148000 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 417/840] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:21 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:21.148458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-080d8c4d-d4ed-4893-910a-a5f5aa267762 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:21.154518 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-080d8c4d-d4ed-4893-910a-a5f5aa267762 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.154970 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-080d8c4d-d4ed-4893-910a-a5f5aa267762 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.155773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-080d8c4d-d4ed-4893-910a-a5f5aa267762 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.156207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-080d8c4d-d4ed-4893-910a-a5f5aa267762 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.233984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-080d8c4d-d4ed-4893-910a-a5f5aa267762 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091481 May 12 14:45:21.234599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 424/841] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:45:21 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:45:22.164171 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:22.164801 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 38ea7027-b13e-4308-980a-84c359ae9be3] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:22.171807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:22.172253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:22.173024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:22.173457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:22.187633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] HTTP exception thrown: Instance 38ea7027-b13e-4308-980a-84c359ae9be3 could not be found. May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Request method failure captured: May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 HTTP/1.1 May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu10Vzf4zHwjPGpyGIXEkwrnVyYUCvGapITUAbDEpSLPgnhEGxFy3O4zPcKY_jY0kkY0XRrLfpfxCJVbShjVem8DkRHlfx7b-F-meb1k0RPerFfY4ndsLpBxaiFeHCm8aKMuGOuDL-GtfRL1bZJsBQoFvU0m2_VXmQaUj6bVeLD44s May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:45:22.189316 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2580eb79c9684c318adbfaa325e7f12c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 99075fda1c7d4e7698e2062407bc2433 May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 38ea7027-b13e-4308-980a-84c359ae9be3 could not be found. May 12 14:45:22.190943 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '38ea7027-b13e-4308-980a-84c359ae9be3'} May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ea7027-b13e-4308-980a-84c359ae9be3 could not be found. May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:45:22.191937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ea7027-b13e-4308-980a-84c359ae9be3 could not be found. May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ea7027-b13e-4308-980a-84c359ae9be3 could not be found. May 12 14:45:22.193471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:22.194843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Returning 404 to user: Instance 38ea7027-b13e-4308-980a-84c359ae9be3 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:45:22.194843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-32df71d0-5e0c-4e4a-8f2c-3247191f7b87 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3" status: 404 len: 111 microversion: 2.1 time: 0.030841 May 12 14:45:22.194843 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 418/842] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:22 2022] GET /compute/v2.1/servers/38ea7027-b13e-4308-980a-84c359ae9be3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:45:22.200594 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-20b3aa88-d87d-4e25-a0f3-0f8f399b93f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '.version_select at 0x7f465099d700>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:22.220700 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-20b3aa88-d87d-4e25-a0f3-0f8f399b93f8 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015039356" status: 202 len: 0 microversion: 2.1 time: 0.024489 May 12 14:45:22.221591 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 425/843] 10.222.0.79 () {58 vars in 1220 bytes} [Thu May 12 14:45:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015039356 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:45:22.323078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-6444cb53-796e-437f-9e0b-d6aca36af4ad req-82464666-fcca-413c-a665-33cc6afdb97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e", "tag": "44d83aed-57c0-4861-9b6d-8063bb15977b"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:22.331051 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-6444cb53-796e-437f-9e0b-d6aca36af4ad req-82464666-fcca-413c-a665-33cc6afdb97e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:22.331489 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-6444cb53-796e-437f-9e0b-d6aca36af4ad req-82464666-fcca-413c-a665-33cc6afdb97e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:22.343117 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-6444cb53-796e-437f-9e0b-d6aca36af4ad req-82464666-fcca-413c-a665-33cc6afdb97e service nova] Creating event network-changed:44d83aed-57c0-4861-9b6d-8063bb15977b for instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e on hv-cinder-84067 May 12 14:45:22.348362 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-6444cb53-796e-437f-9e0b-d6aca36af4ad req-82464666-fcca-413c-a665-33cc6afdb97e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094707 May 12 14:45:22.349379 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 419/844] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:25.145589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:25.146108 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:25.153281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:25.153739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:25.154510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:25.154949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:25.180304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:45:25.268938 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9d9c4000-9001-4955-923a-f10b5074a68f tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "DELETE /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 204 len: 0 microversion: 2.1 time: 0.128075 May 12 14:45:25.269520 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 426/845] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:45:25 2022] DELETE /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:45:25.279055 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:25.279796 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:25.286863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:25.287324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:25.288221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:25.288657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:25.430817 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:25.438991 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6de72a69-1b50-4e87-8105-03b2fc2216ea tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1505 microversion: 2.1 time: 0.164725 May 12 14:45:25.439568 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 420/846] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:25 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:26.457054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:26.457844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:26.464470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:26.464922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:26.465687 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:26.466114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:26.667198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:26.675029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b4f6d1ec-95ed-4787-aed5-f4925d787b02 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 200 len: 1505 microversion: 2.1 time: 0.222315 May 12 14:45:26.675711 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 427/847] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:26 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:26.772243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-97986b86-6365-4e68-9f34-9588eca5e923 req-958f0d92-2c76-4b34-8edd-23c25bca61b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71021fe5-ffce-4c41-8578-8c810987915c", "name": "network-vif-deleted", "tag": "b7400c71-756f-4d64-b80c-1f914eadab6d"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:26.783000 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-97986b86-6365-4e68-9f34-9588eca5e923 req-958f0d92-2c76-4b34-8edd-23c25bca61b7 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:26.783437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-97986b86-6365-4e68-9f34-9588eca5e923 req-958f0d92-2c76-4b34-8edd-23c25bca61b7 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:26.795667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-97986b86-6365-4e68-9f34-9588eca5e923 req-958f0d92-2c76-4b34-8edd-23c25bca61b7 service nova] Creating event network-vif-deleted:b7400c71-756f-4d64-b80c-1f914eadab6d for instance 71021fe5-ffce-4c41-8578-8c810987915c on hv-cinder-84067 May 12 14:45:26.801105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-97986b86-6365-4e68-9f34-9588eca5e923 req-958f0d92-2c76-4b34-8edd-23c25bca61b7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032411 May 12 14:45:26.802412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 421/848] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:27.697980 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:27.698914 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 71021fe5-ffce-4c41-8578-8c810987915c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:27.709371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:27.709851 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:27.710614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:27.711046 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:27.724686 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] HTTP exception thrown: Instance 71021fe5-ffce-4c41-8578-8c810987915c could not be found. May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Request method failure captured: May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c HTTP/1.1 May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu10Vzf4zHwjPGpyGIXEkwrnVyYUCvGapITUAbDEpSLPgnhEGxFy3O4zPcKY_jY0kkY0XRrLfpfxCJVbShjVem8DkRHlfx7b-F-meb1k0RPerFfY4ndsLpBxaiFeHCm8aKMuGOuDL-GtfRL1bZJsBQoFvU0m2_VXmQaUj6bVeLD44s May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:45:27.726306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2580eb79c9684c318adbfaa325e7f12c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 99075fda1c7d4e7698e2062407bc2433 May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 71021fe5-ffce-4c41-8578-8c810987915c could not be found. May 12 14:45:27.727913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '71021fe5-ffce-4c41-8578-8c810987915c'} May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71021fe5-ffce-4c41-8578-8c810987915c could not be found. May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:45:27.728975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71021fe5-ffce-4c41-8578-8c810987915c could not be found. May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71021fe5-ffce-4c41-8578-8c810987915c could not be found. May 12 14:45:27.730424 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:27.731761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Returning 404 to user: Instance 71021fe5-ffce-4c41-8578-8c810987915c could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:45:27.731761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5a90d25d-d67b-485e-b9cb-ee59bad31364 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c" status: 404 len: 111 microversion: 2.1 time: 0.036476 May 12 14:45:27.731761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 428/849] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:27 2022] GET /compute/v2.1/servers/71021fe5-ffce-4c41-8578-8c810987915c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:45:27.736878 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:27.737457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:27.744356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:27.744829 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:27.745533 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:27.745960 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:27.773225 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:45:27.855557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-03d0544e-ff9a-4f4a-aab9-f2442dc4c956 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 204 len: 0 microversion: 2.1 time: 0.122476 May 12 14:45:27.856526 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 422/850] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:45:27 2022] DELETE /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 14:45:27.864628 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:27.865230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:27.871171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:27.871634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:27.872400 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:27.872833 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:28.004621 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:28.012166 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c13e1fb3-c827-417b-b2db-148623bcce89 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.151743 May 12 14:45:28.012729 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 429/851] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:27 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:29.033760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:29.034368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:29.042678 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:29.043120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:29.043961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:29.044397 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:29.257239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99075fda1c7d4e7698e2062407bc2433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2580eb79c9684c318adbfaa325e7f12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:29.265130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6b206bab-aab8-4314-857d-5d181f242607 tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 200 len: 1520 microversion: 2.1 time: 0.238201 May 12 14:45:29.266074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 423/852] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:29 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:29.372357 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-2ef61967-6936-42b1-b246-18dca7301dce req-4a9d4f3a-e4f7-41c0-9af7-da796f3f0c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe4da68-32b7-45fc-930e-651d23fc4595", "name": "network-vif-deleted", "tag": "94227bdb-a088-403e-92ec-13093a4ba02d"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:29.382246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-2ef61967-6936-42b1-b246-18dca7301dce req-4a9d4f3a-e4f7-41c0-9af7-da796f3f0c85 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:29.382918 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-2ef61967-6936-42b1-b246-18dca7301dce req-4a9d4f3a-e4f7-41c0-9af7-da796f3f0c85 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:29.396078 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-2ef61967-6936-42b1-b246-18dca7301dce req-4a9d4f3a-e4f7-41c0-9af7-da796f3f0c85 service nova] Creating event network-vif-deleted:94227bdb-a088-403e-92ec-13093a4ba02d for instance 1fe4da68-32b7-45fc-930e-651d23fc4595 on hv-cinder-84067 May 12 14:45:29.401325 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-2ef61967-6936-42b1-b246-18dca7301dce req-4a9d4f3a-e4f7-41c0-9af7-da796f3f0c85 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 May 12 14:45:29.401931 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 430/853] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:30.286354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:30.286956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] [instance: 1fe4da68-32b7-45fc-930e-651d23fc4595] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:30.294864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:30.295353 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:30.296240 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:30.296708 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:30.310751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] HTTP exception thrown: Instance 1fe4da68-32b7-45fc-930e-651d23fc4595 could not be found. May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Request method failure captured: May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 HTTP/1.1 May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu10Vzf4zHwjPGpyGIXEkwrnVyYUCvGapITUAbDEpSLPgnhEGxFy3O4zPcKY_jY0kkY0XRrLfpfxCJVbShjVem8DkRHlfx7b-F-meb1k0RPerFfY4ndsLpBxaiFeHCm8aKMuGOuDL-GtfRL1bZJsBQoFvU0m2_VXmQaUj6bVeLD44s May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:45:30.312443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2580eb79c9684c318adbfaa325e7f12c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2580eb79c9684c318adbfaa325e7f12c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 2580eb79c9684c318adbfaa325e7f12c May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-85170659 May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 99075fda1c7d4e7698e2062407bc2433 May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-85170659-project May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 1fe4da68-32b7-45fc-930e-651d23fc4595 could not be found. May 12 14:45:30.313972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '1fe4da68-32b7-45fc-930e-651d23fc4595'} May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe4da68-32b7-45fc-930e-651d23fc4595 could not be found. May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:45:30.314773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe4da68-32b7-45fc-930e-651d23fc4595 could not be found. May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe4da68-32b7-45fc-930e-651d23fc4595 could not be found. May 12 14:45:30.316070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:45:30.317376 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] Returning 404 to user: Instance 1fe4da68-32b7-45fc-930e-651d23fc4595 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:45:30.317376 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-df8024dc-32db-4a53-aca5-8001d8af058a tempest-ServerRescueNegativeTestJSON-85170659 tempest-ServerRescueNegativeTestJSON-85170659-project] 10.222.0.79 "GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595" status: 404 len: 111 microversion: 2.1 time: 0.034086 May 12 14:45:30.317376 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 424/854] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:30 2022] GET /compute/v2.1/servers/1fe4da68-32b7-45fc-930e-651d23fc4595 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:45:54.460359 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7283ad1f-fcd7-421e-89b8-1ad0dfc1629b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:54.461966 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7283ad1f-fcd7-421e-89b8-1ad0dfc1629b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:54.472214 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7283ad1f-fcd7-421e-89b8-1ad0dfc1629b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:54.472917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7283ad1f-fcd7-421e-89b8-1ad0dfc1629b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:54.474078 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7283ad1f-fcd7-421e-89b8-1ad0dfc1629b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:54.474739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7283ad1f-fcd7-421e-89b8-1ad0dfc1629b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:54.506725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7283ad1f-fcd7-421e-89b8-1ad0dfc1629b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054706 May 12 14:45:54.507275 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 431/855] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:45:54 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:45:54.568188 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:54.568775 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:54.574785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:54.575222 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:54.576001 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:54.576484 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:54.603211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:45:54.687680 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-18eb5f0e-df6c-44f8-9fad-57241a3ecf61 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 204 len: 0 microversion: 2.1 time: 0.123367 May 12 14:45:54.688487 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 425/856] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:45:54 2022] DELETE /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 14:45:54.696987 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:54.697590 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:54.703934 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:54.704376 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:54.705134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:54.705560 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:54.847102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:54.854816 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-86184b4c-c0a6-4060-bf8a-d25f5f31c281 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1673 microversion: 2.1 time: 0.161699 May 12 14:45:54.855470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 432/857] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:54 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:55.874994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:55.875793 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:55.882281 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:55.882890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:55.883486 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:55.884025 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:56.020084 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:56.027864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1f8aaac3-3170-4fd4-90c5-2d14c7d1fae3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1673 microversion: 2.1 time: 0.158071 May 12 14:45:56.028432 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 426/858] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:55 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:57.046184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:57.047860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:57.055504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:57.056237 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:57.057274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:57.057903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:57.146540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:57.154542 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e0ff64d9-aa38-4ade-ade4-148eabfe1ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 200 len: 1606 microversion: 2.1 time: 0.112182 May 12 14:45:57.155456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 433/859] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:57 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 1606 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:57.169633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-afcb5884-7789-4e01-8293-92740192a60a req-b4d474e7-d393-4da4-a45e-32169b8a6537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843e0ce-6156-4d75-9341-c049c6297133", "name": "network-vif-deleted", "tag": "4e5a3761-d09e-48c6-943e-29a687c9f984"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:57.179119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-afcb5884-7789-4e01-8293-92740192a60a req-b4d474e7-d393-4da4-a45e-32169b8a6537 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:57.179730 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-afcb5884-7789-4e01-8293-92740192a60a req-b4d474e7-d393-4da4-a45e-32169b8a6537 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:57.193003 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-afcb5884-7789-4e01-8293-92740192a60a req-b4d474e7-d393-4da4-a45e-32169b8a6537 service nova] Creating event network-vif-deleted:4e5a3761-d09e-48c6-943e-29a687c9f984 for instance f843e0ce-6156-4d75-9341-c049c6297133 on hv-cinder-84067 May 12 14:45:57.198572 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-afcb5884-7789-4e01-8293-92740192a60a req-b4d474e7-d393-4da4-a45e-32169b8a6537 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 May 12 14:45:57.203086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 427/860] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:58.172553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:58.173159 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:58.179713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:58.180304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:58.181082 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:58.181559 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:58.197727 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] HTTP exception thrown: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Request method failure captured: May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 HTTP/1.1 May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu8Xynjzk3LWQYxRwL9frfvj4WrgvjESvNzA9JBg_7I6MLo5vce-7DxqNaJOUYnq7knVJlQewdHhsAVrrzbG8yyObvibCCryBt1dMuodkHOSJOaFpkj1ZA3GjpNlMVhOaiOL4M9N4FFR4pj-hoq8MCwCItzyyEkHpEWyqxdUvpMP_Y May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:45:58.199479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4bfc0cf739ef49329b3abc976a5cf1ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeTestJSON-1602866691 May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 8d318a968c834567a30e9788e752cdc6 May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:45:58.201396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'f843e0ce-6156-4d75-9341-c049c6297133'} May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:45:58.206985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:45:58.208738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:45:58.210116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Returning 404 to user: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:45:58.210116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-41618418-0f37-4c74-8ae1-d992f2a2ce86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 404 len: 111 microversion: 2.1 time: 0.032481 May 12 14:45:58.210116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 434/861] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:45:58 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:45:58.212146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7d57341e-e59b-40a6-a01c-ddcaabc765ab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '.version_select at 0x7f46509a2ca0>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:58.232410 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7d57341e-e59b-40a6-a01c-ddcaabc765ab tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750619581" status: 202 len: 0 microversion: 2.1 time: 0.024929 May 12 14:45:58.233557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 428/862] 10.222.0.79 () {58 vars in 1220 bytes} [Thu May 12 14:45:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750619581 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:45:58.893903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-26e6ceda-b4d8-43e3-aec3-66349880f886 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'create', calling method: .version_select at 0x7f4650a70dc0>, body: {"keypair": {"name": "tempest-keypair-966107626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNRcMzIKimq+R+8Smzoq4bw+HO/ntYUYPSN3pcky2Lgjw/yB21/1fI6cpXrMxQ4V5FyMkrahKqlGxQGg/U51ZCg+LEg6bSU0oyM5qil2+492qyfF7Yh2dLYIzhAW+6mhA=="}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:58.908221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-26e6ceda-b4d8-43e3-aec3-66349880f886 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:45:58.912661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-26e6ceda-b4d8-43e3-aec3-66349880f886 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for user 8d318a968c834567a30e9788e752cdc6 and project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:45:58.941711 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-26e6ceda-b4d8-43e3-aec3-66349880f886 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051918 May 12 14:45:58.942377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 435/863] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:45:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:00.666300 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1741111200", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4082a23-e2c1-47cf-8408-55f5d6e4d99e"}], "security_groups": [{"name": "tempest-securitygroup--486796414"}], "key_name": "tempest-keypair-966107626", "user_data": "}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:00.772872 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] validate_networks() for [('e4082a23-e2c1-47cf-8408-55f5d6e4d99e', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:46:01.266330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:46:01.266830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:46:01.267397 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:46:01.268117 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:46:01.268627 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:46:01.281361 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:01.281802 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:01.282657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:01.283138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:01.300338 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:46:01.304874 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Getting quotas for user 8d318a968c834567a30e9788e752cdc6 and project 4bfc0cf739ef49329b3abc976a5cf1ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:46:01.316426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:46:01.318789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:46:01.366525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-03bec9cf-9b18-4e17-b56e-133716fca1fd tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.705280 May 12 14:46:01.367147 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 429/864] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:46:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:46:01.378172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ba37be72-69d2-4f36-bf3a-96ded0b15ef0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:01.378953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ba37be72-69d2-4f36-bf3a-96ded0b15ef0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:01.442160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ba37be72-69d2-4f36-bf3a-96ded0b15ef0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:01.449631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ba37be72-69d2-4f36-bf3a-96ded0b15ef0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1237 microversion: 2.1 time: 0.076050 May 12 14:46:01.450231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 436/865] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:01 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:02.467278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:02.469117 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:02.479886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:02.480678 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:02.481715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:02.482412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:02.854432 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:02.863388 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5e73e3fa-15fb-49cf-8120-e445cec400e7 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1297 microversion: 2.1 time: 0.399373 May 12 14:46:02.870166 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 430/866] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:02 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1297 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:03.880458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:03.881033 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:03.887967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:03.888412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:03.889154 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:03.889615 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:04.101364 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:04.110544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e5da1839-dd79-4693-adb1-fddbde039690 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.233436 May 12 14:46:04.111450 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 437/867] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:03 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:04.321014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-ba926fc7-237d-49a8-8570-02da9d4e6e21 req-d2c964a1-0b47-4ccd-ac2d-176356449203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4abbf89-aa43-4ab3-a7d7-73ce8c79562f", "tag": "3025e7d9-221e-4eb3-b3d4-4e0d728df36f"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:04.331817 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-ba926fc7-237d-49a8-8570-02da9d4e6e21 req-d2c964a1-0b47-4ccd-ac2d-176356449203 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:04.332644 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-ba926fc7-237d-49a8-8570-02da9d4e6e21 req-d2c964a1-0b47-4ccd-ac2d-176356449203 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:04.345458 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-ba926fc7-237d-49a8-8570-02da9d4e6e21 req-d2c964a1-0b47-4ccd-ac2d-176356449203 service nova] Creating event network-changed:3025e7d9-221e-4eb3-b3d4-4e0d728df36f for instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f on hv-cinder-84067 May 12 14:46:04.350456 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-ba926fc7-237d-49a8-8570-02da9d4e6e21 req-d2c964a1-0b47-4ccd-ac2d-176356449203 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033321 May 12 14:46:04.351339 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 431/868] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:05.129873 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:05.130461 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:05.137083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:05.137529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:05.138282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:05.138684 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:05.270495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:05.278560 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ad2bbf06-8501-463f-aae4-e20a6e8a0f3b tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.152877 May 12 14:46:05.279129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 438/869] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:05 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:46:06.301013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:06.301889 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:06.310141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:06.310709 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:06.311672 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:06.312257 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:06.454070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:06.462360 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c98b6975-0d52-4cc8-a377-946f5f4b39c5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.168705 May 12 14:46:06.462937 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 432/870] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:06 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:07.479969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:07.480558 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:07.487928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:07.488379 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:07.489157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:07.489593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:07.687655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:07.695952 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-253b3508-e99e-4361-b3ce-52a4437d0efc tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.219863 May 12 14:46:07.696530 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 439/871] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:07 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:08.717066 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:08.718080 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:08.726183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:08.726637 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:08.727408 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:08.727884 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:08.872542 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:08.880105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8299edbd-0747-41ab-a9bd-53a4724d1027 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.169523 May 12 14:46:08.880691 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 433/872] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:08 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:09.901479 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:09.902538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:09.914456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:09.915569 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:09.917884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:09.919061 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:10.074198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:10.081739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c7271b0c-e8e5-43bb-971f-09d4b3860de6 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.186712 May 12 14:46:10.082322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 440/873] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:09 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:10.589091 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-610832fc-4924-40cd-80ec-452df4f42873 req-65d5789d-1f18-499b-9d64-8abeb78e3aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4abbf89-aa43-4ab3-a7d7-73ce8c79562f", "name": "network-vif-plugged", "status": "completed", "tag": "3025e7d9-221e-4eb3-b3d4-4e0d728df36f"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:10.598588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-610832fc-4924-40cd-80ec-452df4f42873 req-65d5789d-1f18-499b-9d64-8abeb78e3aa9 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:10.599029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-610832fc-4924-40cd-80ec-452df4f42873 req-65d5789d-1f18-499b-9d64-8abeb78e3aa9 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:10.610698 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-610832fc-4924-40cd-80ec-452df4f42873 req-65d5789d-1f18-499b-9d64-8abeb78e3aa9 service nova] Creating event network-vif-plugged:3025e7d9-221e-4eb3-b3d4-4e0d728df36f for instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f on hv-cinder-84067 May 12 14:46:10.615888 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-610832fc-4924-40cd-80ec-452df4f42873 req-65d5789d-1f18-499b-9d64-8abeb78e3aa9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 May 12 14:46:10.616475 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 434/874] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:11.103417 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:11.104433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:11.115601 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:11.116355 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:11.117624 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:11.118353 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:11.270397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:11.281340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-010108a8-09d4-479b-9607-6100a90bdc86 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.184178 May 12 14:46:11.282213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 441/875] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:11 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:12.306011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:12.306703 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:12.313732 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:12.314182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:12.314956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:12.315436 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:12.467030 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:12.476160 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-62f0d75b-13da-4a06-bc05-1f88ca954ddb tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1362 microversion: 2.1 time: 0.174880 May 12 14:46:12.476745 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 435/876] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:12 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:13.497136 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:13.498097 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:13.509473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:13.510249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:13.511617 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:13.512566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:13.657448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:13.665684 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0cfbf079-7b92-446c-be36-16a7eed526d4 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1549 microversion: 2.1 time: 0.175054 May 12 14:46:13.666619 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 442/877] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:13 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:13.682625 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-664ce2b9-f0c9-4e1d-a255-d01b27ef4036 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:13.683167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-664ce2b9-f0c9-4e1d-a255-d01b27ef4036 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:13.690268 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-664ce2b9-f0c9-4e1d-a255-d01b27ef4036 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:13.690712 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-664ce2b9-f0c9-4e1d-a255-d01b27ef4036 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:13.691489 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-664ce2b9-f0c9-4e1d-a255-d01b27ef4036 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:13.691990 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-664ce2b9-f0c9-4e1d-a255-d01b27ef4036 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:13.770503 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-664ce2b9-f0c9-4e1d-a255-d01b27ef4036 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091605 May 12 14:46:13.771319 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 436/878] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:46:13 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:14.796788 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-95959a10-e1b4-42e5-8726-50bcc00227c4 req-7f0113ea-5b27-45a9-8310-862c89f6ce1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4abbf89-aa43-4ab3-a7d7-73ce8c79562f", "tag": "3025e7d9-221e-4eb3-b3d4-4e0d728df36f"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:14.805482 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-95959a10-e1b4-42e5-8726-50bcc00227c4 req-7f0113ea-5b27-45a9-8310-862c89f6ce1e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:14.805922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-95959a10-e1b4-42e5-8726-50bcc00227c4 req-7f0113ea-5b27-45a9-8310-862c89f6ce1e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:14.820458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-95959a10-e1b4-42e5-8726-50bcc00227c4 req-7f0113ea-5b27-45a9-8310-862c89f6ce1e service nova] Creating event network-changed:3025e7d9-221e-4eb3-b3d4-4e0d728df36f for instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f on hv-cinder-84067 May 12 14:46:14.823180 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-95959a10-e1b4-42e5-8726-50bcc00227c4 req-7f0113ea-5b27-45a9-8310-862c89f6ce1e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029778 May 12 14:46:14.823917 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 443/879] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:23.708274 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ade7315e-f198-48c2-8ad8-874de3691a56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:23.709260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ade7315e-f198-48c2-8ad8-874de3691a56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:23.719553 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ade7315e-f198-48c2-8ad8-874de3691a56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:23.720355 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ade7315e-f198-48c2-8ad8-874de3691a56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:23.721670 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ade7315e-f198-48c2-8ad8-874de3691a56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:23.722110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ade7315e-f198-48c2-8ad8-874de3691a56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:23.746734 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ade7315e-f198-48c2-8ad8-874de3691a56 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/ips" status: 200 len: 152 microversion: 2.20 time: 0.045925 May 12 14:46:23.747295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 437/880] 10.222.0.79 () {60 vars in 1288 bytes} [Thu May 12 14:46:23 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:46:25.732373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:25.733113 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:25.741227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:25.741677 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:25.742455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:25.742891 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:25.766279 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'flavor' on Instance uuid 05cf6710-d383-4d92-8328-2812361411a4 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:46:26.053941 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4e525a9d-c39d-4c2d-a849-7084848f9d6f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/action" status: 202 len: 0 microversion: 2.20 time: 0.328264 May 12 14:46:26.054596 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 444/881] 10.222.0.79 () {62 vars in 1318 bytes} [Thu May 12 14:46:25 2022] POST /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:46:26.063830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:26.064528 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:26.071571 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:26.072231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:26.073046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:26.073520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:26.212789 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:26.221420 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:26.222959 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:26.224190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ce7bd898-5eb7-4929-a55c-86d03d177bb7 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.165069 May 12 14:46:26.224760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 438/882] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:26 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:27.250194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:27.251343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:27.262168 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:27.262909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:27.264228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:27.264946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:27.407534 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:27.416510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:27.418008 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:27.419160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b775214d-4965-42c0-9722-f255e209e14f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.177212 May 12 14:46:27.419740 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 445/883] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:27 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:28.442021 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:28.443008 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:28.454018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:28.454769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:28.456013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:28.456612 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:28.762073 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:28.770868 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:28.772445 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:28.773611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9034807c-3541-43e9-90d3-f026e7d3e8c4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.338225 May 12 14:46:28.774173 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 439/884] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:28 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:29.797234 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:29.798198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:29.809171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:29.809923 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:29.811193 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:29.811965 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:29.962887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:29.971213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:29.973137 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:29.974310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-192e1a5f-9363-4967-9dfa-465f9cc34a2b tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.184134 May 12 14:46:29.974880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 446/885] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:29 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:30.995071 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:30.995788 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:31.004204 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:31.005062 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:31.006090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:31.006635 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:31.151220 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:31.159318 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:31.161129 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:31.162279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fdb3c72d-6845-4a10-996c-10034d5b9221 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.172322 May 12 14:46:31.162851 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 440/886] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:30 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:32.181670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:32.182307 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:32.195394 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:32.195911 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:32.196690 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:32.197127 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:32.347289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:32.355587 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:32.357093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:32.358244 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4a042036-a486-4f7c-b478-d65916d4fbe1 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.180586 May 12 14:46:32.358885 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 447/887] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:32 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:33.381045 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:33.381642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:33.388568 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:33.389014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:33.389790 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:33.390219 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:33.526336 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:33.534986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:33.536746 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:33.537900 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-58f3a2c3-bd36-4f09-834b-48ade11529cb tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.163109 May 12 14:46:33.538440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 441/888] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:33 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:34.559635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:34.560626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:34.569722 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:34.570398 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:34.571532 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:34.572088 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:34.725768 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:34.733879 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:34.735366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:34.736542 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d75fa2f5-e1cb-489c-8f26-7d4f1592c199 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.181986 May 12 14:46:34.737111 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 448/889] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:34 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:35.757850 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:35.758487 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:35.765421 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:35.765886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:35.766652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:35.767117 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:35.901773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:35.910020 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:35.911510 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:35.912717 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-31d60cda-ecdc-44e8-a357-ced1151d890a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.160745 May 12 14:46:35.913283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 442/890] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:35 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:36.932827 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:36.933433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:36.940606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.941051 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:36.941831 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.942261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:37.076332 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:37.084890 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:37.086435 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:37.087601 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-aa12bee3-b88d-4bf6-8049-fe22f26a5bf0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.158751 May 12 14:46:37.088207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 449/891] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:36 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:38.111615 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:38.112231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:38.119144 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:38.119585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:38.120384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:38.120808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:38.251512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:38.259454 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:38.260965 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:38.262116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f7e274c7-c1e0-46d2-9c2f-b09a786de0c9 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1745 microversion: 2.20 time: 0.154454 May 12 14:46:38.262664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 443/892] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:38 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:39.286946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:39.288060 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:39.296118 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:39.296568 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:39.297336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:39.297775 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:39.434514 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:39.442798 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:39.444377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:39.445647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5f939bb9-fc68-4089-9a6f-6ff9643473e0 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1745 microversion: 2.20 time: 0.165220 May 12 14:46:39.446221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 450/893] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:39 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:40.465540 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:40.466108 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:40.473046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:40.473498 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:40.474272 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:40.474709 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:40.566737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-cb17b795-68da-483b-a3b7-17746964c2aa req-ba3c4e82-ff0a-4e0b-9ea3-eed13afa9660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf6710-d383-4d92-8328-2812361411a4", "name": "network-vif-plugged", "status": "completed", "tag": "a6930fb7-573c-4eee-bf16-c9de09bd6eb3"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:40.575432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-cb17b795-68da-483b-a3b7-17746964c2aa req-ba3c4e82-ff0a-4e0b-9ea3-eed13afa9660 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:40.575915 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-cb17b795-68da-483b-a3b7-17746964c2aa req-ba3c4e82-ff0a-4e0b-9ea3-eed13afa9660 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:40.588143 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-cb17b795-68da-483b-a3b7-17746964c2aa req-ba3c4e82-ff0a-4e0b-9ea3-eed13afa9660 service nova] Creating event network-vif-plugged:a6930fb7-573c-4eee-bf16-c9de09bd6eb3 for instance 05cf6710-d383-4d92-8328-2812361411a4 on hv-cinder-84067 May 12 14:46:40.593550 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-cb17b795-68da-483b-a3b7-17746964c2aa req-ba3c4e82-ff0a-4e0b-9ea3-eed13afa9660 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030298 May 12 14:46:40.594454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 451/894] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:40.616101 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:40.624121 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:40.625596 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:40.626737 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-283b6630-e045-416f-8b40-542b07f8e6c6 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1745 microversion: 2.20 time: 0.165744 May 12 14:46:40.627320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 444/895] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:40 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:41.651733 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:41.652867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:41.663582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:41.664475 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:41.665401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:41.666176 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:41.825112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:41.835982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:41.838162 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:41.839338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9e186836-273b-4555-a43c-04399e8a6aed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1745 microversion: 2.20 time: 0.195614 May 12 14:46:41.839967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 452/896] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:41 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:42.859554 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:42.860410 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:42.868149 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:42.868600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:42.869364 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:42.869798 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:43.008347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:43.016585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:43.018114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:43.019380 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2b7a3b99-3342-48b7-a238-5778c38ad98d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1745 microversion: 2.20 time: 0.165621 May 12 14:46:43.019953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 445/897] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:42 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:44.042265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:44.042949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:44.050951 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:44.051488 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:44.052453 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:44.052963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:44.193771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:44.206567 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:44.208830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:44.210572 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8e72f84b-9f6e-483b-ab4b-63c13f4b747f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1745 microversion: 2.20 time: 0.174750 May 12 14:46:44.211519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 453/898] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:44 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:45.229125 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:45.229732 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:45.236190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:45.236650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:45.237421 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:45.237855 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:45.368790 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:45.377457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:45.379330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:45.380889 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c81064be-b50e-4c47-813d-5df4f55182e4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.155612 May 12 14:46:45.382069 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 446/899] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:45 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:46.400349 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:46.401724 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:46.408029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:46.408528 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:46.409533 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:46.410228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:46.558221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:46.569163 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:46.570891 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:46.572131 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c9d945a8-a5e6-4f17-a56f-e3ebcfd91e65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.175788 May 12 14:46:46.583295 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 454/900] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:46 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:47.590550 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:47.591998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:47.598956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:47.599401 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:47.600260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:47.600711 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:47.740132 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:47.749011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:47.750536 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:47.751760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a7b3c6be-3006-423c-a424-38f354d7a391 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.165274 May 12 14:46:47.752631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 447/901] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:47 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:48.770693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:48.772043 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:48.778985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:48.779430 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:48.780254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:48.780682 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:48.925123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:48.933742 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:48.935208 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:48.936420 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b2a8fdc2-af95-4816-94c9-34d49caa4891 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.169892 May 12 14:46:48.938265 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 455/902] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:48 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:49.954598 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:49.955791 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:49.963126 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:49.963625 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:49.964515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:49.965057 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:50.111653 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:50.121839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:50.123993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:50.125329 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9c7b55d3-cb04-4196-8d1e-f05b71ce09da tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.174623 May 12 14:46:50.136374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 448/903] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:49 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:51.146586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:51.147956 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:51.162086 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:51.162621 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:51.163936 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:51.164377 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:51.314002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:51.325755 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:51.327313 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:51.328575 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-50612a11-4a96-4072-a77d-f7bbbdbd0bfe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.188171 May 12 14:46:51.329385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 456/904] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:51 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:52.006178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0c85dd22-8be3-4f94-bf89-fdb2639b591c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:52.007325 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0c85dd22-8be3-4f94-bf89-fdb2639b591c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:52.015945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c85dd22-8be3-4f94-bf89-fdb2639b591c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:52.016721 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c85dd22-8be3-4f94-bf89-fdb2639b591c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:52.017588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c85dd22-8be3-4f94-bf89-fdb2639b591c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:52.018353 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c85dd22-8be3-4f94-bf89-fdb2639b591c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:52.053326 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0c85dd22-8be3-4f94-bf89-fdb2639b591c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/ips" status: 200 len: 149 microversion: 2.1 time: 0.053499 May 12 14:46:52.053900 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 449/905] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:46:51 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:52.348896 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:52.349515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:52.359982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:52.361911 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:52.364458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:52.366030 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:52.545116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:52.553680 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:52.555550 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:52.557157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-030c42dc-49ab-4b9b-94fa-25e4c0837a3c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.213457 May 12 14:46:52.558183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 457/906] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:52 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:53.439047 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e1312561-521b-4206-b3d2-ef56b067f3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "517126d7-0cb1-459e-8d40-7057f28433f0"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:53.440356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e1312561-521b-4206-b3d2-ef56b067f3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:53.446648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1312561-521b-4206-b3d2-ef56b067f3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:53.447122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1312561-521b-4206-b3d2-ef56b067f3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:53.447999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1312561-521b-4206-b3d2-ef56b067f3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:53.448428 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e1312561-521b-4206-b3d2-ef56b067f3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:53.580040 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:53.581241 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:53.591844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:53.592790 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:53.593777 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:53.594272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:53.752202 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:53.764085 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:53.765986 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:53.767376 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f724f6f9-dfa4-4276-9c69-795f8ef1b7c8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.193577 May 12 14:46:53.779475 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 458/907] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:53 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:46:53.808237 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e1312561-521b-4206-b3d2-ef56b067f3d9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373204 May 12 14:46:53.809574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 450/908] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:46:53 2022] POST /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:54.787309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:54.788774 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:54.810089 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.811010 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.812876 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.814753 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.850950 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:54.852156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:54.858980 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.859427 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.860244 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.882009 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.937646 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:46:55.069211 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:55.082070 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-928a0d17-471f-440e-9af9-e709105de915 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 204 len: 0 microversion: 2.1 time: 0.235353 May 12 14:46:55.082317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:55.084570 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:55.086122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-68d50ec4-8a43-423a-af77-3f5e446d4d73 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.303599 May 12 14:46:55.091827 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 459/910] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:54 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:55.096587 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 451/910] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:46:54 2022] DELETE /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:46:55.101521 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-9594ae87-d251-488d-b043-dd8695500024 req-29a82482-099f-457a-84d4-70836bce127d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9198b32a-74d2-4298-bed5-be716180d682", "tag": "5e60855e-b1bf-4dc0-8a72-5c0e800298c2"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:55.104887 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:55.105848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:55.112608 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:55.113368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:55.114336 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:55.114945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:55.121802 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-9594ae87-d251-488d-b043-dd8695500024 req-29a82482-099f-457a-84d4-70836bce127d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:55.122397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-9594ae87-d251-488d-b043-dd8695500024 req-29a82482-099f-457a-84d4-70836bce127d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:55.137973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-9594ae87-d251-488d-b043-dd8695500024 req-29a82482-099f-457a-84d4-70836bce127d service nova] Creating event network-changed:5e60855e-b1bf-4dc0-8a72-5c0e800298c2 for instance 9198b32a-74d2-4298-bed5-be716180d682 on hv-cinder-84067 May 12 14:46:55.152571 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-9594ae87-d251-488d-b043-dd8695500024 req-29a82482-099f-457a-84d4-70836bce127d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058995 May 12 14:46:55.153969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 460/911] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:55.274911 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:55.282925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a0a11dd2-074f-42b1-9877-49c4b8529023 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.184958 May 12 14:46:55.283484 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 452/912] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:55 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:56.109720 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:56.110566 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:56.118854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:56.119548 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:56.120496 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:56.120937 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:56.260353 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:56.272712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:56.275078 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:56.276467 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3ef89678-9336-49e9-93c6-5a1be2b83c69 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1740 microversion: 2.20 time: 0.171642 May 12 14:46:56.277051 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 461/913] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:56 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:56.300078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:56.300720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:56.307217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:56.307663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:56.308459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:56.308891 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:56.474801 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:56.482694 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ccb4f2d7-4495-4bb5-9d68-ac87dca77253 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.186559 May 12 14:46:56.483271 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 453/914] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:56 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:57.297640 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:57.298326 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:57.306553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:57.307103 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:57.308098 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:57.308629 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:57.450537 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:57.463110 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:57.465564 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:57.467178 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-50f0ba7d-aec6-4dcb-80fb-9dce9e31c7dc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1722 microversion: 2.20 time: 0.174311 May 12 14:46:57.468072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 462/915] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:57 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:57.500298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:57.500881 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:57.508075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:57.508516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:57.509239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:57.509885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:57.717754 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:57.725643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3d4fffe4-79f2-4036-b8b0-069f54407470 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1570 microversion: 2.1 time: 0.229252 May 12 14:46:57.726247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 454/916] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:57 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:58.327953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-c3840f6c-045f-41a5-9f2b-2cd594ab5574 req-d387bd7d-7510-48a7-8035-748b0e5d47ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9198b32a-74d2-4298-bed5-be716180d682", "name": "network-vif-deleted", "tag": "5e60855e-b1bf-4dc0-8a72-5c0e800298c2"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:58.338374 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c3840f6c-045f-41a5-9f2b-2cd594ab5574 req-d387bd7d-7510-48a7-8035-748b0e5d47ee service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:58.338838 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c3840f6c-045f-41a5-9f2b-2cd594ab5574 req-d387bd7d-7510-48a7-8035-748b0e5d47ee service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:58.350631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-c3840f6c-045f-41a5-9f2b-2cd594ab5574 req-d387bd7d-7510-48a7-8035-748b0e5d47ee service nova] Creating event network-vif-deleted:5e60855e-b1bf-4dc0-8a72-5c0e800298c2 for instance 9198b32a-74d2-4298-bed5-be716180d682 on hv-cinder-84067 May 12 14:46:58.355504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-c3840f6c-045f-41a5-9f2b-2cd594ab5574 req-d387bd7d-7510-48a7-8035-748b0e5d47ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031870 May 12 14:46:58.356645 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 463/917] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:58.491288 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:58.491932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:58.498826 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:58.499270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:58.500143 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:58.500523 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:58.641100 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:58.650632 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:58.652499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:58.653701 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3f701971-7beb-4773-9315-37c3213633a5 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1722 microversion: 2.20 time: 0.166676 May 12 14:46:58.654449 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 455/918] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:58 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:58.742949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:58.744016 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:58.750303 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:58.750679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:58.751434 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:58.751888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:58.817957 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:58.826379 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-07c0a758-2245-4f25-87d3-a7289d7e0c93 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1220 microversion: 2.1 time: 0.087630 May 12 14:46:58.826984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 464/919] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:58 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:59.673260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:59.674229 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:59.684813 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:59.685439 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:59.686654 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:59.687357 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:59.839740 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:59.842973 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:59.843608 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:59.848965 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:59.850110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:59.850488 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:59.851003 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:59.851300 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f02f2399-45b6-48a6-9fa6-94248b5b4429 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1722 microversion: 2.20 time: 0.182295 May 12 14:46:59.851892 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 456/920] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:46:59 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:59.852038 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:59.852401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:59.925595 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:59.933809 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d3b62310-fee9-429e-9486-1db14f32dc75 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1220 microversion: 2.1 time: 0.094826 May 12 14:46:59.934362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 465/921] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:46:59 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:00.597430 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-347820e7-d56f-40e6-9894-6a3c80c6ee3b req-6f464aed-acee-4d57-b2a5-84f12b9cbae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf6710-d383-4d92-8328-2812361411a4", "name": "network-vif-unplugged", "status": "completed", "tag": "a6930fb7-573c-4eee-bf16-c9de09bd6eb3"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:00.606617 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-347820e7-d56f-40e6-9894-6a3c80c6ee3b req-6f464aed-acee-4d57-b2a5-84f12b9cbae4 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:00.607146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-347820e7-d56f-40e6-9894-6a3c80c6ee3b req-6f464aed-acee-4d57-b2a5-84f12b9cbae4 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:00.621894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-347820e7-d56f-40e6-9894-6a3c80c6ee3b req-6f464aed-acee-4d57-b2a5-84f12b9cbae4 service nova] Creating event network-vif-unplugged:a6930fb7-573c-4eee-bf16-c9de09bd6eb3 for instance 05cf6710-d383-4d92-8328-2812361411a4 on hv-cinder-84067 May 12 14:47:00.627930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-347820e7-d56f-40e6-9894-6a3c80c6ee3b req-6f464aed-acee-4d57-b2a5-84f12b9cbae4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034511 May 12 14:47:00.629210 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 457/922] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:00.871773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:00.872367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:00.879230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:00.879676 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:00.880549 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:00.880974 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:00.958301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:00.960076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:00.968657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:00.969212 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:00.970530 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:00.971098 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.004576 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.005127 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.005650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lazy-loading 'fault' on Instance uuid 9198b32a-74d2-4298-bed5-be716180d682 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:47:01.020256 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:01.028419 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:01.029913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:01.031121 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-11b070ff-9cc2-48d9-9d4f-beb27a697ed3 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1725 microversion: 2.20 time: 0.163601 May 12 14:47:01.031710 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 466/923] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:00 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:01.052027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-23c2410c-0517-4898-835a-500625f5e65f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab2c473e-3a19-41da-ae00-e7a513bb3d40"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:01.053187 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-23c2410c-0517-4898-835a-500625f5e65f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:01.053329 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6607707914d03886d6c3081cc122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323bfd19e97146e39c34d3ba12370590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:01.059661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-23c2410c-0517-4898-835a-500625f5e65f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.060152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-23c2410c-0517-4898-835a-500625f5e65f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.060925 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-23c2410c-0517-4898-835a-500625f5e65f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.061064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-70919885-3b62-4b49-8a12-c8b53420db29 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 200 len: 1225 microversion: 2.1 time: 0.107727 May 12 14:47:01.061358 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-23c2410c-0517-4898-835a-500625f5e65f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.061690 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 458/924] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:00 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:01.365969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-23c2410c-0517-4898-835a-500625f5e65f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317858 May 12 14:47:01.366642 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 467/925] 10.222.0.79 () {62 vars in 1363 bytes} [Thu May 12 14:47:01 2022] POST /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:47:01.482027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-35b28cec-ca71-4763-8a3b-a3d4b7105294 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:01.482529 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-35b28cec-ca71-4763-8a3b-a3d4b7105294 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:01.488774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-35b28cec-ca71-4763-8a3b-a3d4b7105294 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.489223 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-35b28cec-ca71-4763-8a3b-a3d4b7105294 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.489975 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-35b28cec-ca71-4763-8a3b-a3d4b7105294 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.490408 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-35b28cec-ca71-4763-8a3b-a3d4b7105294 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.776227 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-35b28cec-ca71-4763-8a3b-a3d4b7105294 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-volume_attachments/ab2c473e-3a19-41da-ae00-e7a513bb3d40" status: 202 len: 0 microversion: 2.20 time: 0.298722 May 12 14:47:01.776896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 459/926] 10.222.0.79 () {60 vars in 1456 bytes} [Thu May 12 14:47:01 2022] DELETE /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-volume_attachments/ab2c473e-3a19-41da-ae00-e7a513bb3d40 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:47:01.833109 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-68cbd957-2759-4fe2-bda1-f5dfe8126fed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:01.833665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-68cbd957-2759-4fe2-bda1-f5dfe8126fed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:01.840910 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68cbd957-2759-4fe2-bda1-f5dfe8126fed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.841356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68cbd957-2759-4fe2-bda1-f5dfe8126fed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.842119 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68cbd957-2759-4fe2-bda1-f5dfe8126fed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.842546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-68cbd957-2759-4fe2-bda1-f5dfe8126fed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.926204 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-68cbd957-2759-4fe2-bda1-f5dfe8126fed tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "POST /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/action" status: 202 len: 0 microversion: 2.20 time: 0.096900 May 12 14:47:01.927779 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 468/927] 10.222.0.79 () {62 vars in 1318 bytes} [Thu May 12 14:47:01 2022] POST /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:47:01.935278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:01.935993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:01.942565 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.943018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:01.943840 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:01.944273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.073915 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:02.079574 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:02.080678 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] [instance: 9198b32a-74d2-4298-bed5-be716180d682] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:02.084971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:02.086483 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:02.087114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.087588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.088502 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f1195b6d-072f-4400-9792-c5f1788538f8 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1673 microversion: 2.20 time: 0.156741 May 12 14:47:02.088681 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.089116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.091725 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 460/928] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:01 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:02.105822 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] HTTP exception thrown: Instance 9198b32a-74d2-4298-bed5-be716180d682 could not be found. May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Request method failure captured: May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 HTTP/1.1 May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRxBy1OfIyuVs8I5LowbGkZQ1AHQjAjNKjYXkJeYZvYPdReXI0WEi3U8a2QzVnNwedA-vpQB-WFjvjVpalQiF8g6k7MaZXOR0PaqEL0dGcrX0oZth3MjUV0pHRFcKMC6rkAZar1SEh667eHtzCIWJydiXR7iJdm_7YV23oFAU1OPBpc May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 323bfd19e97146e39c34d3ba12370590 May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-TestShelveInstance-797075388 May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:47:02.107485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/323bfd19e97146e39c34d3ba12370590"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/323bfd19e97146e39c34d3ba12370590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_323bfd19e97146e39c34d3ba12370590", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/323bfd19e97146e39c34d3ba12370590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-TestShelveInstance-797075388 May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 323bfd19e97146e39c34d3ba12370590 May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-TestShelveInstance-797075388 May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-TestShelveInstance-797075388-project May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 39a6607707914d03886d6c3081cc122e May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-TestShelveInstance-797075388-project May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 9198b32a-74d2-4298-bed5-be716180d682 could not be found. May 12 14:47:02.109206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '9198b32a-74d2-4298-bed5-be716180d682'} May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9198b32a-74d2-4298-bed5-be716180d682 could not be found. May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:47:02.110066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9198b32a-74d2-4298-bed5-be716180d682 could not be found. May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9198b32a-74d2-4298-bed5-be716180d682 could not be found. May 12 14:47:02.111385 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.112694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Returning 404 to user: Instance 9198b32a-74d2-4298-bed5-be716180d682 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:47:02.112694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2070c59c-e875-4e95-a44b-a71449d9fa65 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682" status: 404 len: 111 microversion: 2.1 time: 0.033222 May 12 14:47:02.112694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 469/929] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:02 2022] GET /compute/v2.1/servers/9198b32a-74d2-4298-bed5-be716180d682 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:47:02.293086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6b86ed17-60b4-4a2b-8545-cbc588989ff0 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] Calling method '.version_select at 0x7f4650ac0a60>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:02.312998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6b86ed17-60b4-4a2b-8545-cbc588989ff0 tempest-TestShelveInstance-797075388 tempest-TestShelveInstance-797075388-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1522243098" status: 202 len: 0 microversion: 2.1 time: 0.024179 May 12 14:47:02.313567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 461/930] 10.222.0.79 () {58 vars in 1253 bytes} [Thu May 12 14:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1522243098 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:47:02.458086 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "517126d7-0cb1-459e-8d40-7057f28433f0"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:02.459337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:02.465888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.466456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.467291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.467852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.557231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Invalid volume: volume 517126d7-0cb1-459e-8d40-7057f28433f0 is already attached to instances: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: POST /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments HTTP/1.1 May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 74 May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:47:02.558888 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {"volumeAttachment": {"volumeId": "517126d7-0cb1-459e-8d40-7057f28433f0"}} May 12 14:47:02.560460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Invalid volume: volume 517126d7-0cb1-459e-8d40-7057f28433f0 is already attached to instances: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'server_id': 'feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e', 'body': {'volumeAttachment': {'volumeId': '517126d7-0cb1-459e-8d40-7057f28433f0'}}} May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 517126d7-0cb1-459e-8d40-7057f28433f0 is already attached to instances: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.561242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 517126d7-0cb1-459e-8d40-7057f28433f0 is already attached to instances: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:02.562392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 517126d7-0cb1-459e-8d40-7057f28433f0 is already attached to instances: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 400 to user: Invalid volume: volume 517126d7-0cb1-459e-8d40-7057f28433f0 is already attached to instances: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cdf40c29-24fb-4d16-93f9-1ec009d3a4ca tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106379 May 12 14:47:02.563589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 470/931] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:47:02 2022] POST /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:47:02.620584 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:02.621112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:02.627215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.627889 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.628852 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.629279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.712913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lazy-loading 'services' on Instance uuid feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:47:02.789356 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d99e95a7-25f0-4bb4-be04-b3e43717b7a6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments/517126d7-0cb1-459e-8d40-7057f28433f0" status: 202 len: 0 microversion: 2.1 time: 0.172533 May 12 14:47:02.789951 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 462/932] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:47:02 2022] DELETE /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments/517126d7-0cb1-459e-8d40-7057f28433f0 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:47:02.798609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-74a3c3e6-5af3-4717-b1c1-ef16859fa18a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:02.799534 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-74a3c3e6-5af3-4717-b1c1-ef16859fa18a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:02.805303 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-74a3c3e6-5af3-4717-b1c1-ef16859fa18a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.805715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-74a3c3e6-5af3-4717-b1c1-ef16859fa18a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.806550 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-74a3c3e6-5af3-4717-b1c1-ef16859fa18a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:02.806960 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-74a3c3e6-5af3-4717-b1c1-ef16859fa18a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:02.837039 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-74a3c3e6-5af3-4717-b1c1-ef16859fa18a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042296 May 12 14:47:02.841502 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 471/933] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:47:02 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:03.107013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:03.107722 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:03.114539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:03.114972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:03.115935 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:03.116363 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:03.247211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:03.255434 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:03.256969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:03.258141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-506416db-4cf0-4ba4-be13-20a55332ae7a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.155460 May 12 14:47:03.258718 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 463/934] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:03 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:03.851944 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bea0d5a6-860e-4b89-954e-c9792a7c8967 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:03.854454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bea0d5a6-860e-4b89-954e-c9792a7c8967 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:03.867530 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bea0d5a6-860e-4b89-954e-c9792a7c8967 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:03.868133 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bea0d5a6-860e-4b89-954e-c9792a7c8967 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:03.869760 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bea0d5a6-860e-4b89-954e-c9792a7c8967 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:03.870356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bea0d5a6-860e-4b89-954e-c9792a7c8967 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:03.909156 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bea0d5a6-860e-4b89-954e-c9792a7c8967 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063252 May 12 14:47:03.910179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 472/935] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:47:03 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:04.280078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:04.280078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:04.291155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:04.291799 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:04.292808 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:04.293314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:04.562337 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:04.575566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:04.577485 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:04.579093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e8ba43bd-d56f-4cad-a203-deb29ce088ea tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.305936 May 12 14:47:04.580262 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 464/936] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:04 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:04.925582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-78767609-0b17-4664-a1b8-b95690d7e4f6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:04.927451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-78767609-0b17-4664-a1b8-b95690d7e4f6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:04.935653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78767609-0b17-4664-a1b8-b95690d7e4f6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:04.936416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78767609-0b17-4664-a1b8-b95690d7e4f6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:04.937387 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78767609-0b17-4664-a1b8-b95690d7e4f6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:04.938092 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78767609-0b17-4664-a1b8-b95690d7e4f6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:04.971544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-78767609-0b17-4664-a1b8-b95690d7e4f6 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053639 May 12 14:47:04.972827 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 473/937] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:47:04 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:47:05.059266 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:05.059266 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:05.065587 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:05.066035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:05.071114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:05.071565 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:05.106865 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:47:05.229083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-32c521a8-7820-4214-b41a-8060c0cd9fe2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 204 len: 0 microversion: 2.1 time: 0.175724 May 12 14:47:05.232969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 465/938] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:47:05 2022] DELETE /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:47:05.239074 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:05.239712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:05.250435 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:05.250884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:05.251844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:05.252338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:05.443658 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:05.453371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-72758726-8068-44d5-9d66-6b22210e0b9c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.218544 May 12 14:47:05.466245 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 474/939] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:05 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:05.609394 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:05.610163 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:05.617461 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:05.618213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:05.619661 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:05.620295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:05.918971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:05.930743 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:05.933075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:05.934392 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d710fc1f-dbec-4857-a987-31b61967262f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.331312 May 12 14:47:05.935599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 466/940] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:05 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:06.472796 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:06.474208 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:06.482260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:06.482626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:06.483593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:06.484369 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:06.952570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:06.953108 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:06.959347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:06.959553 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:06.960013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:06.960785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:06.961208 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:06.969900 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-78c0c1a8-c115-4faf-a17d-59d4c83ad0e1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.500994 May 12 14:47:06.971291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 475/941] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:06 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:07.218027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:07.226406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:07.228334 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:07.230431 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6344e794-91f6-4696-b312-5339abf046be tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.281786 May 12 14:47:07.231146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 467/942] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:06 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:47:07.988237 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:07.988852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:08.011167 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:08.012130 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:08.014426 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:08.015024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:08.222909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:08.231369 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ad3e6b2c-5de1-4ffb-b65e-c66274db4141 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.246947 May 12 14:47:08.232896 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 476/943] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:07 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:08.249753 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:08.251057 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:08.258622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:08.259352 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:08.260657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:08.261293 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:08.492128 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:08.501524 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:08.503273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:08.504669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3e72e21c-5aac-4bd3-8f2c-70061b85af27 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.259075 May 12 14:47:08.505467 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 468/944] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:08 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:09.251075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:09.251676 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:09.258363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:09.259047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:09.260100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:09.260802 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:09.501599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:09.509861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d928363a-87e7-4046-a681-6e552ae7e909 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.262860 May 12 14:47:09.521334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 477/945] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:09 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:09.529260 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:09.529873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:09.537793 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:09.538250 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:09.539052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:09.539575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:09.800810 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:09.810290 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:09.812378 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:09.813908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8474423c-e281-4f26-b942-55839b50e170 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.294570 May 12 14:47:09.815038 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 469/946] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:09 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:47:10.528874 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:10.529982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:10.538201 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:10.538900 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:10.539928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:10.540550 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:10.755004 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:10.773737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-242d0192-c75c-43f3-94b5-98fd34cb8aaf tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.247036 May 12 14:47:10.775535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 478/947] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:10 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:10.832759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:10.848738 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:10.864151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:10.864613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:10.865538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:10.867150 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:11.074923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:11.093116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:11.099928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:11.107585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-270a992a-5d7a-47f4-898b-67375647f5dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.278976 May 12 14:47:11.108221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 470/948] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:10 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:11.795358 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:11.796187 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:11.802652 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:11.803093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:11.803909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:11.804334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:11.961391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:11.973707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cf2f05d2-a89f-4645-bf02-17f15be16277 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.181989 May 12 14:47:11.974610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 479/949] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:11 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:12.130620 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:12.132448 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:12.154053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:12.154053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:12.154053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:12.154053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:12.343630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:12.353656 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:12.355352 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:12.357041 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8e833678-9b44-45e7-9d2c-6ffe57ab1b1d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.233941 May 12 14:47:12.357602 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 471/950] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:12 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:12.990770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:12.991475 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:12.998804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:12.999386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:13.000285 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:13.000949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:13.144661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:13.153372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7eb15db4-8d27-40e3-978b-7bf4b76990f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.166532 May 12 14:47:13.153971 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 480/951] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:12 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:13.375672 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:13.376319 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:13.383183 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:13.383636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:13.384719 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:13.385171 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:13.530533 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:13.538368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:13.539876 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:13.541429 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-95aa703f-30d3-4377-b113-0cc8d2908261 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.169383 May 12 14:47:13.541993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 472/952] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:13 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:14.171432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:14.172090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:14.178854 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:14.179302 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:14.180100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:14.180530 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:14.321694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:14.329894 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4cb9a8af-7a48-4a67-9659-9bb7cb2b649b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.162430 May 12 14:47:14.330482 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 481/953] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:14 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:14.563583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:14.564515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:14.574780 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:14.575218 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:14.576060 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:14.576486 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:14.718491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:14.727098 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:14.728617 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:14.729774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4f32d33e-5f80-46ce-91c1-239e701ec851 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.173015 May 12 14:47:14.730331 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 473/954] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:14 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:15.351728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:15.352711 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:15.360635 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:15.361090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:15.361866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:15.362310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:15.504626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:15.514459 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4be169c6-8d09-40d7-ba0d-fa82e2acc3ec tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.169245 May 12 14:47:15.515006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 482/955] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:15 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:15.752546 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:15.753440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:15.762815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:15.763256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:15.764056 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:15.764487 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:15.898936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:15.907862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:15.909354 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:15.910508 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2016695b-aeed-4dc5-8912-97bfaa2a3065 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.164716 May 12 14:47:15.911049 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 474/956] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:15 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:16.532485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:16.533094 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:16.539577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:16.540055 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:16.541165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:16.541637 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:16.850413 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:16.858334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ff078e3c-3dff-4aa7-917c-dedc761193ea tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.329979 May 12 14:47:16.858882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 483/957] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:16 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:16.933491 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:16.934236 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:16.942338 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:16.942884 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:16.944116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:16.944619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:17.076968 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:17.087524 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:17.090130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:17.091863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9541f953-bf64-4154-af0e-80eaf6099209 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.164394 May 12 14:47:17.092574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 475/958] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:16 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:17.876398 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:17.876976 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:17.883840 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:17.884293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:17.885278 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:17.885562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:18.021880 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:18.029949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-adbc543c-77f8-44d1-830d-026de8721376 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.157524 May 12 14:47:18.030522 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 484/959] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:17 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:18.118765 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:18.119908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:18.126893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:18.127340 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:18.128168 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:18.128600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:18.262441 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:18.276429 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:18.277908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:18.279034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9197f502-7b13-4bf4-83f4-00e74e45ce48 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.166974 May 12 14:47:18.279603 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 476/960] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:18 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:19.049329 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:19.050009 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:19.058495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:19.058940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:19.059725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:19.060177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:19.202650 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:19.210609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a1995404-e93c-4dd9-867d-087e7dff42de tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.166194 May 12 14:47:19.211521 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 485/961] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:19 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:19.304190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:19.304798 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:19.312755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:19.313197 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:19.313976 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:19.314406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:19.452541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:19.465787 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:19.468124 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:19.469890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a05d10ab-e767-487d-aaed-ead285321ccc tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.169467 May 12 14:47:19.470676 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 477/962] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:19 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:20.230712 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:20.231335 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:20.238534 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:20.238984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:20.239771 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:20.240202 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:20.390821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:20.402379 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c0e783ca-534b-471f-a5c3-e314a7368081 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1681 microversion: 2.1 time: 0.175960 May 12 14:47:20.402945 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 486/963] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:20 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:20.494819 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:20.496061 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:20.502825 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:20.503320 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:20.504195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:20.504630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:20.638493 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:20.646619 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:20.648178 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:20.649312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e95c1379-f3d5-4a9b-8fd6-ccb54d3e7d14 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.161329 May 12 14:47:20.649877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 478/964] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:20 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:20.704157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-7101cb7b-db46-41d7-b52a-205094e91970 req-7205c312-0219-463a-9769-79b1662865d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf6710-d383-4d92-8328-2812361411a4", "name": "network-vif-plugged", "status": "completed", "tag": "a6930fb7-573c-4eee-bf16-c9de09bd6eb3"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:20.715352 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-7101cb7b-db46-41d7-b52a-205094e91970 req-7205c312-0219-463a-9769-79b1662865d2 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:20.715828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-7101cb7b-db46-41d7-b52a-205094e91970 req-7205c312-0219-463a-9769-79b1662865d2 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:20.727950 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-7101cb7b-db46-41d7-b52a-205094e91970 req-7205c312-0219-463a-9769-79b1662865d2 service nova] Creating event network-vif-plugged:a6930fb7-573c-4eee-bf16-c9de09bd6eb3 for instance 05cf6710-d383-4d92-8328-2812361411a4 on hv-cinder-84067 May 12 14:47:20.733403 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-7101cb7b-db46-41d7-b52a-205094e91970 req-7205c312-0219-463a-9769-79b1662865d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035241 May 12 14:47:20.734049 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 487/965] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:21.421196 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:21.422042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:21.428091 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:21.428541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:21.429307 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:21.429795 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:21.507668 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:21.515302 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-90ed786c-2dd3-420c-ac4a-aa3ce72fd035 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1613 microversion: 2.1 time: 0.098185 May 12 14:47:21.515945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 479/966] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:21 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:21.670240 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:21.670961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:21.677353 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:21.677796 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:21.678564 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:21.678999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:21.849759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-2312631f-663e-4160-b2fe-2da012bb2f57 req-559aa560-5ff4-4113-bec0-1ea00b443afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e", "name": "network-vif-deleted", "tag": "44d83aed-57c0-4861-9b6d-8063bb15977b"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:21.861801 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-2312631f-663e-4160-b2fe-2da012bb2f57 req-559aa560-5ff4-4113-bec0-1ea00b443afc service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:21.862566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-2312631f-663e-4160-b2fe-2da012bb2f57 req-559aa560-5ff4-4113-bec0-1ea00b443afc service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:21.874928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:21.877569 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-2312631f-663e-4160-b2fe-2da012bb2f57 req-559aa560-5ff4-4113-bec0-1ea00b443afc service nova] Creating event network-vif-deleted:44d83aed-57c0-4861-9b6d-8063bb15977b for instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e on hv-cinder-84067 May 12 14:47:21.883140 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-2312631f-663e-4160-b2fe-2da012bb2f57 req-559aa560-5ff4-4113-bec0-1ea00b443afc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038311 May 12 14:47:21.885153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:21.887337 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 480/967] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:47:21.888021 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:21.889350 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d342a5ac-f42e-4cbb-871b-0e985f53b125 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.224938 May 12 14:47:21.895643 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 488/968] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:21 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:22.534011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:22.534856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:22.542157 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:22.542620 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:22.543509 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:22.544313 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:22.580610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:22.581164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:22.581519 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lazy-loading 'fault' on Instance uuid feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:47:22.633873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:22.641964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2d21f68e-f46b-4998-9e81-4cefe52a4090 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 200 len: 1331 microversion: 2.1 time: 0.112609 May 12 14:47:22.642520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 481/969] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:22 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:22.907583 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:22.908338 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:22.915233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:22.916260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:22.917229 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:22.917992 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:23.074953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:23.084847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:23.086341 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:23.087852 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b2f2594f-610c-4e4c-aff1-cc1d93bc6c17 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1731 microversion: 2.20 time: 0.184526 May 12 14:47:23.088490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 489/970] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:22 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:23.663580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:23.664698 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:23.675993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:23.676728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:23.677984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:23.678700 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:23.697999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e HTTP/1.1 May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:47:23.700309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:47:23.701962 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e'} May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:47:23.702779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:47:23.704324 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:47:23.705695 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:47:23.705695 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e3636e1f-9dcd-4fed-90ab-2c36035415ce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 404 len: 111 microversion: 2.1 time: 0.044662 May 12 14:47:23.705695 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 482/971] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:23 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:47:23.710674 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-19075e5b-4dd0-4641-80a4-5243c53ffd0f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '.version_select at 0x7f4651fb5820>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:23.731393 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-19075e5b-4dd0-4641-80a4-5243c53ffd0f tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757280015" status: 202 len: 0 microversion: 2.1 time: 0.024425 May 12 14:47:23.731981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 490/972] 10.222.0.79 () {58 vars in 1217 bytes} [Thu May 12 14:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757280015 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:47:24.106087 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:24.106886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:24.113146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:24.113590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:24.114351 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:24.114779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:24.245288 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:24.254285 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:24.255890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:24.257054 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fdf55365-5c35-4056-aad7-e6d58768fe7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1718 microversion: 2.20 time: 0.155039 May 12 14:47:24.257610 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 483/973] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:47:24 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:24.368389 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d6236093-bcba-4c53-b297-9c20a9f48d54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: .version_select at 0x7f46509a9b80>, body: {"keypair": {"name": "tempest-keypair-1899728889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUmOt9YKST6aTkPWNMjArG4TXmXEQd8JUpKZssW0VBTFZ2dB+Uc0h4tcjMPYz1zwVWzbJ4Omv43GPoiIDRFRaymRWm8/ijUPwOlmdWMJH1EqXD1rCjOC7AqwWQkI80mug=="}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:24.384803 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-d6236093-bcba-4c53-b297-9c20a9f48d54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:47:24.389336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-d6236093-bcba-4c53-b297-9c20a9f48d54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:47:24.412913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d6236093-bcba-4c53-b297-9c20a9f48d54 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051765 May 12 14:47:24.413533 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 491/974] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:47:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:25.760140 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1978994031", "imageRef": "cc1d27c9-fa8d-441c-8ceb-dae17e06d54c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d1d321-0090-41ca-9dd0-9f717585a523"}], "security_groups": [{"name": "tempest-securitygroup--835060954"}], "key_name": "tempest-keypair-1899728889", "user_data": "}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:25.874606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] validate_networks() for [('45d1d321-0090-41ca-9dd0-9f717585a523', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:47:26.253966 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:47:26.254652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:47:26.255422 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:47:26.256028 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:47:26.256578 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:47:26.267457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:26.267939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:26.268755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:26.269191 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:26.286292 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:47:26.290739 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Getting quotas for user ab522f0209154f959a431caa01f3a029 and project 9794155ca0aa4b75a153f0640e068ff5. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:47:26.303961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:47:26.306233 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc1d27c9-fa8d-441c-8ceb-dae17e06d54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:47:26.354562 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c21596bd-98cf-4f8b-9f79-1a24770a2379 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599891 May 12 14:47:26.355253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 484/975] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:47:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:47:26.365743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8fef8026-a78b-4072-988b-f40c82d64795 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:26.366458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8fef8026-a78b-4072-988b-f40c82d64795 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:26.422491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8fef8026-a78b-4072-988b-f40c82d64795 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:26.429331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8fef8026-a78b-4072-988b-f40c82d64795 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1242 microversion: 2.1 time: 0.067491 May 12 14:47:26.429913 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 492/976] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:26 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:27.446479 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:27.447791 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:27.455603 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:27.456079 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:27.456866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:27.457301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:27.529630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:27.537415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-29add2e1-9415-4602-964a-be86042025f4 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1302 microversion: 2.1 time: 0.094837 May 12 14:47:27.537995 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 485/977] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:27 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:28.557968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:28.558579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:28.566042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:28.566490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:28.567260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:28.567887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:28.944693 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:28.953121 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-78ecc65d-dc84-4ae1-935e-d418c906859a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.399522 May 12 14:47:28.953704 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 493/978] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:28 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:29.312534 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-8ee6677e-fc0d-4111-9356-ca10aecb07d1 req-8bf3ea15-1e79-4412-98a6-05cef6fc239b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc", "tag": "027da599-4cf6-4e03-9ae4-24ae61e29323"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:29.335566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-8ee6677e-fc0d-4111-9356-ca10aecb07d1 req-8bf3ea15-1e79-4412-98a6-05cef6fc239b service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:29.336116 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-8ee6677e-fc0d-4111-9356-ca10aecb07d1 req-8bf3ea15-1e79-4412-98a6-05cef6fc239b service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:29.349418 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-8ee6677e-fc0d-4111-9356-ca10aecb07d1 req-8bf3ea15-1e79-4412-98a6-05cef6fc239b service nova] Creating event network-changed:027da599-4cf6-4e03-9ae4-24ae61e29323 for instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc on hv-cinder-84067 May 12 14:47:29.354826 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-8ee6677e-fc0d-4111-9356-ca10aecb07d1 req-8bf3ea15-1e79-4412-98a6-05cef6fc239b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046370 May 12 14:47:29.355932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 486/979] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:29.974428 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:29.975291 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:29.984591 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:29.985042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:29.985814 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:29.986245 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:30.136453 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:30.147869 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d41e8a25-3264-4149-a6eb-02df34495e3a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.179850 May 12 14:47:30.148543 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 494/980] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:29 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:31.169748 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:31.170665 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:31.179898 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:31.180495 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:31.181525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:31.182151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:31.381207 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:31.389530 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8b244bbe-70e4-4a6d-b109-83e6c24d3208 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.226040 May 12 14:47:31.390151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 487/981] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:31 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:32.410685 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:32.411227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:32.418221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:32.419143 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:32.419960 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:32.420408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:32.558049 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:32.572157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5e8df9c6-dc78-4aff-8f17-9b32f3ce30d2 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.165314 May 12 14:47:32.572749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 495/982] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:32 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:33.589560 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:33.590172 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:33.597963 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:33.598409 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:33.599186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:33.599624 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:33.731841 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:33.739526 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a35b71d0-a8dc-49db-96dc-73c4dbac12a7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.153964 May 12 14:47:33.740138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 488/983] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:33 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:34.756175 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:34.756804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:34.764176 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:34.764632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:34.765418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:34.765856 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:34.821408 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-bc5de793-784d-408e-bcea-d08ce690fab4 req-d9d9857d-cd9b-4892-9dbb-32163a7a2bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc", "name": "network-vif-plugged", "status": "completed", "tag": "027da599-4cf6-4e03-9ae4-24ae61e29323"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:34.833015 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-bc5de793-784d-408e-bcea-d08ce690fab4 req-d9d9857d-cd9b-4892-9dbb-32163a7a2bea service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:34.833465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-bc5de793-784d-408e-bcea-d08ce690fab4 req-d9d9857d-cd9b-4892-9dbb-32163a7a2bea service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:34.848555 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-bc5de793-784d-408e-bcea-d08ce690fab4 req-d9d9857d-cd9b-4892-9dbb-32163a7a2bea service nova] Creating event network-vif-plugged:027da599-4cf6-4e03-9ae4-24ae61e29323 for instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc on hv-cinder-84067 May 12 14:47:34.854825 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-bc5de793-784d-408e-bcea-d08ce690fab4 req-d9d9857d-cd9b-4892-9dbb-32163a7a2bea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042797 May 12 14:47:34.855500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 489/984] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:47:34.907144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:34.916513 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-65127b00-6795-4a61-beee-d5bb31441960 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.163888 May 12 14:47:34.917106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 496/985] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:34 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:35.939954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:35.941104 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:35.951224 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:35.951672 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:35.952479 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:35.952918 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:36.098358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:36.107289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-adf08c44-b74b-491e-a005-7d809dbe2772 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.174756 May 12 14:47:36.108186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 490/986] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:35 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:37.134423 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:37.135349 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:37.147002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:37.147978 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:37.149568 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:37.150361 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:37.287716 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:37.295528 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-80a3e73a-437e-41da-809b-8f935d753392 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1367 microversion: 2.1 time: 0.167613 May 12 14:47:37.296126 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 497/987] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:37 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:38.314918 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:38.315554 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:38.322773 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:38.323243 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:38.324090 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:38.324541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:38.468939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:47:38.478264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-bfe7797d-0233-4068-ac8a-c90c1348dfa1 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1558 microversion: 2.1 time: 0.168026 May 12 14:47:38.478862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 491/988] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:47:38 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:47:38.502572 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-498f9c87-0b1c-4a42-9ad7-3c46a9c48539 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:38.503151 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-498f9c87-0b1c-4a42-9ad7-3c46a9c48539 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:38.511362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-498f9c87-0b1c-4a42-9ad7-3c46a9c48539 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:38.512054 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-498f9c87-0b1c-4a42-9ad7-3c46a9c48539 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:38.513261 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-498f9c87-0b1c-4a42-9ad7-3c46a9c48539 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:38.513881 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-498f9c87-0b1c-4a42-9ad7-3c46a9c48539 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:38.598455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-498f9c87-0b1c-4a42-9ad7-3c46a9c48539 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100113 May 12 14:47:38.599322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 498/989] 10.222.0.79 () {58 vars in 1274 bytes} [Thu May 12 14:47:38 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:39.864282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-15026ba4-9306-4f55-8723-6fd15f44add3 req-6406742f-e39e-4248-9865-5f719d182448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc", "tag": "027da599-4cf6-4e03-9ae4-24ae61e29323"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:39.872831 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-15026ba4-9306-4f55-8723-6fd15f44add3 req-6406742f-e39e-4248-9865-5f719d182448 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:39.873272 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-15026ba4-9306-4f55-8723-6fd15f44add3 req-6406742f-e39e-4248-9865-5f719d182448 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:39.884239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-15026ba4-9306-4f55-8723-6fd15f44add3 req-6406742f-e39e-4248-9865-5f719d182448 service nova] Creating event network-changed:027da599-4cf6-4e03-9ae4-24ae61e29323 for instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc on hv-cinder-84067 May 12 14:47:39.889132 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-15026ba4-9306-4f55-8723-6fd15f44add3 req-6406742f-e39e-4248-9865-5f719d182448 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028523 May 12 14:47:39.889708 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 492/990] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:44.567599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bbe09941-c9aa-43e7-ac3f-d70e5e9098b5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:44.568327 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bbe09941-c9aa-43e7-ac3f-d70e5e9098b5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:44.575079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bbe09941-c9aa-43e7-ac3f-d70e5e9098b5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:44.575531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bbe09941-c9aa-43e7-ac3f-d70e5e9098b5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:44.576333 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bbe09941-c9aa-43e7-ac3f-d70e5e9098b5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:44.576769 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bbe09941-c9aa-43e7-ac3f-d70e5e9098b5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:44.600319 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bbe09941-c9aa-43e7-ac3f-d70e5e9098b5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/ips" status: 200 len: 146 microversion: 2.1 time: 0.037726 May 12 14:47:44.600877 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 499/991] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:47:44 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:45.946762 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a83d8a40-5c1d-4ffe-90ae-af004c0603e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "268a1d9d-42b6-4f1c-81cd-49df167a3339"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:45.948266 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a83d8a40-5c1d-4ffe-90ae-af004c0603e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:45.957522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a83d8a40-5c1d-4ffe-90ae-af004c0603e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:45.958088 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a83d8a40-5c1d-4ffe-90ae-af004c0603e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:45.959085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a83d8a40-5c1d-4ffe-90ae-af004c0603e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:45.959743 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a83d8a40-5c1d-4ffe-90ae-af004c0603e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:46.239991 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a83d8a40-5c1d-4ffe-90ae-af004c0603e3 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300901 May 12 14:47:46.240675 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 493/992] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:47:45 2022] POST /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:53.815467 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-85493393-58af-4913-ba99-d92791c15520 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:53.816490 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-85493393-58af-4913-ba99-d92791c15520 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:53.823281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85493393-58af-4913-ba99-d92791c15520 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:53.823743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85493393-58af-4913-ba99-d92791c15520 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:53.824546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85493393-58af-4913-ba99-d92791c15520 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:53.824988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-85493393-58af-4913-ba99-d92791c15520 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:53.856298 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-85493393-58af-4913-ba99-d92791c15520 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045325 May 12 14:47:53.856863 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 500/993] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:47:53 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:53.868930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f88e2b5c-6352-4727-8cc8-00567984a469 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:47:53.869493 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f88e2b5c-6352-4727-8cc8-00567984a469 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:53.876251 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f88e2b5c-6352-4727-8cc8-00567984a469 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:53.877036 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f88e2b5c-6352-4727-8cc8-00567984a469 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:53.878019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f88e2b5c-6352-4727-8cc8-00567984a469 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:53.878459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f88e2b5c-6352-4727-8cc8-00567984a469 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:53.907034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f88e2b5c-6352-4727-8cc8-00567984a469 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/268a1d9d-42b6-4f1c-81cd-49df167a3339" status: 200 len: 194 microversion: 2.1 time: 0.042964 May 12 14:47:53.907597 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 494/994] 10.222.0.79 () {58 vars in 1412 bytes} [Thu May 12 14:47:53 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/268a1d9d-42b6-4f1c-81cd-49df167a3339 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:47:55.247321 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-718e1bb1-17ff-42e4-8202-0a4a379e90f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb2d6b7a-a239-4b63-bfc7-074020408d97"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:47:55.248425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-718e1bb1-17ff-42e4-8202-0a4a379e90f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:47:55.255124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-718e1bb1-17ff-42e4-8202-0a4a379e90f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:55.255572 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-718e1bb1-17ff-42e4-8202-0a4a379e90f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:55.256372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-718e1bb1-17ff-42e4-8202-0a4a379e90f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:47:55.256806 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-718e1bb1-17ff-42e4-8202-0a4a379e90f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:47:55.549252 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-718e1bb1-17ff-42e4-8202-0a4a379e90f0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "POST /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305800 May 12 14:47:55.549859 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 501/995] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:47:55 2022] POST /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:03.076720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-cf0e8617-4f9f-4579-a333-55166ac8e515 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:03.078186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-cf0e8617-4f9f-4579-a333-55166ac8e515 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:03.089172 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf0e8617-4f9f-4579-a333-55166ac8e515 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:03.089869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf0e8617-4f9f-4579-a333-55166ac8e515 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:03.090971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf0e8617-4f9f-4579-a333-55166ac8e515 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:03.091583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cf0e8617-4f9f-4579-a333-55166ac8e515 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:03.124256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-cf0e8617-4f9f-4579-a333-55166ac8e515 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054493 May 12 14:48:03.124830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 495/996] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:48:03 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:03.275863 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ec3ba4cf-494d-4ad1-a8fa-f8fd9896b551 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:03.276781 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ec3ba4cf-494d-4ad1-a8fa-f8fd9896b551 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:03.286169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3ba4cf-494d-4ad1-a8fa-f8fd9896b551 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:03.286622 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3ba4cf-494d-4ad1-a8fa-f8fd9896b551 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:03.287396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3ba4cf-494d-4ad1-a8fa-f8fd9896b551 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:03.287868 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3ba4cf-494d-4ad1-a8fa-f8fd9896b551 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:03.317048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ec3ba4cf-494d-4ad1-a8fa-f8fd9896b551 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/268a1d9d-42b6-4f1c-81cd-49df167a3339" status: 200 len: 194 microversion: 2.1 time: 0.049345 May 12 14:48:03.317625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 502/997] 10.222.0.79 () {58 vars in 1412 bytes} [Thu May 12 14:48:03 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/268a1d9d-42b6-4f1c-81cd-49df167a3339 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:03.327674 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:03.328122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:03.334655 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:03.335097 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:03.336137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:03.336562 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:03.422557 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lazy-loading 'services' on Instance uuid d4abbf89-aa43-4ab3-a7d7-73ce8c79562f {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:03.507545 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3a78bfa8-01d8-49f2-a40e-912a3fa41dff tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/268a1d9d-42b6-4f1c-81cd-49df167a3339" status: 202 len: 0 microversion: 2.1 time: 0.178437 May 12 14:48:03.508203 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 496/998] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:48:03 2022] DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/268a1d9d-42b6-4f1c-81cd-49df167a3339 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:48:05.691642 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-82615ad3-79d6-4035-b030-9c825f70f74f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:05.692231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-82615ad3-79d6-4035-b030-9c825f70f74f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:05.699015 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-82615ad3-79d6-4035-b030-9c825f70f74f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:05.699480 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-82615ad3-79d6-4035-b030-9c825f70f74f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:05.700305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-82615ad3-79d6-4035-b030-9c825f70f74f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:05.700745 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-82615ad3-79d6-4035-b030-9c825f70f74f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:05.731402 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-82615ad3-79d6-4035-b030-9c825f70f74f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/eb2d6b7a-a239-4b63-bfc7-074020408d97" status: 200 len: 194 microversion: 2.1 time: 0.043835 May 12 14:48:05.732048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 503/999] 10.222.0.79 () {58 vars in 1412 bytes} [Thu May 12 14:48:05 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/eb2d6b7a-a239-4b63-bfc7-074020408d97 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:05.744476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:05.745048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:05.752599 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:05.753056 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:05.753845 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:05.754278 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:05.841815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lazy-loading 'services' on Instance uuid d4abbf89-aa43-4ab3-a7d7-73ce8c79562f {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:05.921164 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-04b27079-fab1-4da5-ba4c-78b8774aa3ac tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/eb2d6b7a-a239-4b63-bfc7-074020408d97" status: 202 len: 0 microversion: 2.1 time: 0.182516 May 12 14:48:05.921785 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 497/1000] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:48:05 2022] DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments/eb2d6b7a-a239-4b63-bfc7-074020408d97 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:48:07.087057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0393b517-5158-494a-8812-6f462dd961e0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:07.088066 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0393b517-5158-494a-8812-6f462dd961e0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:07.095255 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0393b517-5158-494a-8812-6f462dd961e0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.095731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0393b517-5158-494a-8812-6f462dd961e0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.096515 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0393b517-5158-494a-8812-6f462dd961e0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.096953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0393b517-5158-494a-8812-6f462dd961e0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.125680 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0393b517-5158-494a-8812-6f462dd961e0 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044544 May 12 14:48:07.126166 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 504/1001] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:48:07 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:48:07.247348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-94188eed-c741-4955-abcf-2c8b92e00de9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:07.249212 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-94188eed-c741-4955-abcf-2c8b92e00de9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:07.256323 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94188eed-c741-4955-abcf-2c8b92e00de9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.256772 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94188eed-c741-4955-abcf-2c8b92e00de9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.257541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94188eed-c741-4955-abcf-2c8b92e00de9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.257971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-94188eed-c741-4955-abcf-2c8b92e00de9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.289650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-94188eed-c741-4955-abcf-2c8b92e00de9 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049275 May 12 14:48:07.290192 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 498/1002] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:48:07 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:48:07.351079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:07.351638 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:07.358411 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.358882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.359654 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.360113 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.384884 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:48:07.472136 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1f9f36e5-9b32-46e3-abd7-66319298f6f8 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 204 len: 0 microversion: 2.1 time: 0.127312 May 12 14:48:07.472860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 505/1003] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:48:07 2022] DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:48:07.483236 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:07.483913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:07.490112 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.490587 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.491360 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:07.491886 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:07.650651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:07.659400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0d8b4d72-d7ff-4f88-942e-cfa4ac15d820 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1673 microversion: 2.1 time: 0.180496 May 12 14:48:07.660071 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 499/1004] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:48:07 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:08.678901 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:08.679563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:08.686949 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:08.687410 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:08.688244 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:08.688687 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:08.845250 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:08.855427 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e10e3f40-f5dd-4e37-92eb-afb8dea8726f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1673 microversion: 2.1 time: 0.181104 May 12 14:48:08.856018 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 506/1005] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:48:08 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:09.874825 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:09.875433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:09.882778 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:09.883225 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:09.884043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:09.884477 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:10.030427 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:10.038430 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-76eec6bb-bd5a-475b-8f01-a39d80125f16 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1673 microversion: 2.1 time: 0.167908 May 12 14:48:10.039012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 500/1006] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:48:09 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:10.977229 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-13eaf7e5-fbbe-4877-81be-a2f68ee704d5 req-c3f1036c-d1c6-4d81-ad05-40803cd839b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4abbf89-aa43-4ab3-a7d7-73ce8c79562f", "name": "network-vif-deleted", "tag": "3025e7d9-221e-4eb3-b3d4-4e0d728df36f"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:10.986909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-13eaf7e5-fbbe-4877-81be-a2f68ee704d5 req-c3f1036c-d1c6-4d81-ad05-40803cd839b0 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:10.987372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-13eaf7e5-fbbe-4877-81be-a2f68ee704d5 req-c3f1036c-d1c6-4d81-ad05-40803cd839b0 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:11.004260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-13eaf7e5-fbbe-4877-81be-a2f68ee704d5 req-c3f1036c-d1c6-4d81-ad05-40803cd839b0 service nova] Creating event network-vif-deleted:3025e7d9-221e-4eb3-b3d4-4e0d728df36f for instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f on hv-cinder-84067 May 12 14:48:11.015193 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-13eaf7e5-fbbe-4877-81be-a2f68ee704d5 req-c3f1036c-d1c6-4d81-ad05-40803cd839b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041536 May 12 14:48:11.015841 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 507/1007] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:11.061636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:11.063321 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:11.072170 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:11.072804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:11.074078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:11.074763 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:11.169130 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d318a968c834567a30e9788e752cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfc0cf739ef49329b3abc976a5cf1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:11.178614 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-396e7051-1542-42d0-8286-06b790d31d66 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 200 len: 1322 microversion: 2.1 time: 0.120949 May 12 14:48:11.179857 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 501/1008] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:48:11 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 1322 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:12.197422 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:12.198313 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:12.205253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:12.205697 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:12.206504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:12.206916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:12.221621 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] HTTP exception thrown: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Request method failure captured: May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f HTTP/1.1 May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu8Xynjzk3LWQYxRwL9frfvj4WrgvjESvNzA9JBg_7I6MLo5vce-7DxqNaJOUYnq7knVJlQewdHhsAVrrzbG8yyObvibCCryBt1dMuodkHOSJOaFpkj1ZA3GjpNlMVhOaiOL4M9N4FFR4pj-hoq8MCwCItzyyEkHpEWyqxdUvpMP_Y May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:48:12.223274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4bfc0cf739ef49329b3abc976a5cf1ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 8d318a968c834567a30e9788e752cdc6 May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:12.224893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'd4abbf89-aa43-4ab3-a7d7-73ce8c79562f'} May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:12.225647 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:12.227268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:12.228963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Returning 404 to user: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:12.228963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-03b154df-048e-4f9f-b082-940344858e82 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 404 len: 111 microversion: 2.1 time: 0.032278 May 12 14:48:12.228963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 508/1009] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:48:12 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:12.235156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c6987a0d-0c75-4beb-9d81-89044399f46f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '.version_select at 0x7f4650b6f3a0>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:12.254518 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c6987a0d-0c75-4beb-9d81-89044399f46f tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966107626" status: 202 len: 0 microversion: 2.1 time: 0.024012 May 12 14:48:12.255186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 502/1010] 10.222.0.79 () {58 vars in 1217 bytes} [Thu May 12 14:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966107626 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:48:15.168902 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:15.169449 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:15.176335 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:15.176776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:15.177544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:15.177974 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:15.191579 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] HTTP exception thrown: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Request method failure captured: May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f HTTP/1.1 May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu8Xynjzk3LWQYxRwL9frfvj4WrgvjESvNzA9JBg_7I6MLo5vce-7DxqNaJOUYnq7knVJlQewdHhsAVrrzbG8yyObvibCCryBt1dMuodkHOSJOaFpkj1ZA3GjpNlMVhOaiOL4M9N4FFR4pj-hoq8MCwCItzyyEkHpEWyqxdUvpMP_Y May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:48:15.193150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4bfc0cf739ef49329b3abc976a5cf1ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 8d318a968c834567a30e9788e752cdc6 May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.194789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'd4abbf89-aa43-4ab3-a7d7-73ce8c79562f'} May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:15.195782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.197356 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:15.198846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Returning 404 to user: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:15.198846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2749a8d2-a59e-4775-8761-1d12016983de tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 404 len: 111 microversion: 2.1 time: 0.029890 May 12 14:48:15.198846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 509/1011] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:48:15 2022] DELETE /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:15.204142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:15.204797 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: d4abbf89-aa43-4ab3-a7d7-73ce8c79562f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:15.211383 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:15.211915 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:15.212683 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:15.213142 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:15.226614 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] HTTP exception thrown: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Request method failure captured: May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f HTTP/1.1 May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu8Xynjzk3LWQYxRwL9frfvj4WrgvjESvNzA9JBg_7I6MLo5vce-7DxqNaJOUYnq7knVJlQewdHhsAVrrzbG8yyObvibCCryBt1dMuodkHOSJOaFpkj1ZA3GjpNlMVhOaiOL4M9N4FFR4pj-hoq8MCwCItzyyEkHpEWyqxdUvpMP_Y May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:48:15.228369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4bfc0cf739ef49329b3abc976a5cf1ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 8d318a968c834567a30e9788e752cdc6 May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.229994 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'd4abbf89-aa43-4ab3-a7d7-73ce8c79562f'} May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:15.230877 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. May 12 14:48:15.232138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:15.233239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Returning 404 to user: Instance d4abbf89-aa43-4ab3-a7d7-73ce8c79562f could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:15.233239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ea70bd13-c8d3-4544-a435-111ab8dbe0f5 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f" status: 404 len: 111 microversion: 2.1 time: 0.030898 May 12 14:48:15.233239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 503/1012] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:48:15 2022] GET /compute/v2.1/servers/d4abbf89-aa43-4ab3-a7d7-73ce8c79562f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:48:16.375869 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:16.376360 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:16.383067 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:16.383550 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:16.384343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:16.384776 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:16.398301 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] HTTP exception thrown: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Request method failure captured: May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: DELETE /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 HTTP/1.1 May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu8Xynjzk3LWQYxRwL9frfvj4WrgvjESvNzA9JBg_7I6MLo5vce-7DxqNaJOUYnq7knVJlQewdHhsAVrrzbG8yyObvibCCryBt1dMuodkHOSJOaFpkj1ZA3GjpNlMVhOaiOL4M9N4FFR4pj-hoq8MCwCItzyyEkHpEWyqxdUvpMP_Y May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:48:16.399940 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4bfc0cf739ef49329b3abc976a5cf1ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: 8d318a968c834567a30e9788e752cdc6 May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.401409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'f843e0ce-6156-4d75-9341-c049c6297133'} May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:16.402129 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.403366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:16.404713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Returning 404 to user: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:16.404713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-970a1435-776e-4247-859b-625111db1938 tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 404 len: 111 microversion: 2.1 time: 0.029402 May 12 14:48:16.404713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 510/1013] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:48:16 2022] DELETE /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:16.412915 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:16.413611 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] [instance: f843e0ce-6156-4d75-9341-c049c6297133] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:16.423738 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:16.424238 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:16.425035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:16.425472 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:16.438541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] HTTP exception thrown: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Request method failure captured: May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 HTTP/1.1 May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu8Xynjzk3LWQYxRwL9frfvj4WrgvjESvNzA9JBg_7I6MLo5vce-7DxqNaJOUYnq7knVJlQewdHhsAVrrzbG8yyObvibCCryBt1dMuodkHOSJOaFpkj1ZA3GjpNlMVhOaiOL4M9N4FFR4pj-hoq8MCwCItzyyEkHpEWyqxdUvpMP_Y May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:48:16.440131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4bfc0cf739ef49329b3abc976a5cf1ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4bfc0cf739ef49329b3abc976a5cf1ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 4bfc0cf739ef49329b3abc976a5cf1ab May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1602866691 May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: 8d318a968c834567a30e9788e752cdc6 May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeTestJSON-1602866691-project May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.441794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'f843e0ce-6156-4d75-9341-c049c6297133'} May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:16.442835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. May 12 14:48:16.444395 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:16.445832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] Returning 404 to user: Instance f843e0ce-6156-4d75-9341-c049c6297133 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:16.445832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ed038275-10a4-4fc8-9eba-1996afd18a5d tempest-AttachVolumeTestJSON-1602866691 tempest-AttachVolumeTestJSON-1602866691-project] 10.222.0.79 "GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133" status: 404 len: 111 microversion: 2.1 time: 0.035459 May 12 14:48:16.445832 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 504/1014] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:48:16 2022] GET /compute/v2.1/servers/f843e0ce-6156-4d75-9341-c049c6297133 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:21.070634 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-afc459ef-5942-4fdb-a7df-271ec2fb82ce tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Action: 'create', calling method: .version_select at 0x7f46509773a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1563463599"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:21.366623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-afc459ef-5942-4fdb-a7df-271ec2fb82ce tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.427460 May 12 14:48:21.367251 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 511/1015] 10.222.0.79 () {60 vars in 1154 bytes} [Thu May 12 14:48:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 429 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 14:48:21.378048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5110ad54-ec4b-47a1-927b-1bbd1d92a67d tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650c02a60>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:21.425504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5110ad54-ec4b-47a1-927b-1bbd1d92a67d tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7" status: 200 len: 345 microversion: 2.1 time: 0.051205 May 12 14:48:21.426097 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 505/1016] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:48:21 2022] GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:22.438308 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-daa5986e-fffa-4eef-a3bc-e00328aaf437 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650906af0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:22.489715 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-daa5986e-fffa-4eef-a3bc-e00328aaf437 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7" status: 200 len: 346 microversion: 2.1 time: 0.055525 May 12 14:48:22.490625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 512/1017] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:48:22 2022] GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:22.505495 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d67562bd-e6db-47de-8221-09fbea1c56a6 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Action: 'create', calling method: .version_select at 0x7f4650b014c0>, body: {"snapshot": {"volume_id": "36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-923116034"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:22.660019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d67562bd-e6db-47de-8221-09fbea1c56a6 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.158942 May 12 14:48:22.660631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 506/1018] 10.222.0.79 () {60 vars in 1161 bytes} [Thu May 12 14:48:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:22.671002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-97d28cc0-7e2a-4b6b-8ad1-a03c5c299b93 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650a004c0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:22.701027 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-97d28cc0-7e2a-4b6b-8ad1-a03c5c299b93 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 200 len: 286 microversion: 2.1 time: 0.033905 May 12 14:48:22.702155 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 513/1019] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:22 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:22.711926 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f8f616e9-5f77-4694-84d6-b4052ef28d94 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650ac00d0>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:22.740542 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f8f616e9-5f77-4694-84d6-b4052ef28d94 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032410 May 12 14:48:22.741147 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 507/1020] 10.222.0.79 () {58 vars in 1139 bytes} [Thu May 12 14:48:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:22.753657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-aa2c7748-2544-4ed0-b20f-592b8c44783e tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650a70820>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:22.784225 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-aa2c7748-2544-4ed0-b20f-592b8c44783e tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 200 len: 286 microversion: 2.1 time: 0.034063 May 12 14:48:22.785272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 514/1021] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:22 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:48:23.802831 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1af9628f-ba9b-4bc5-a60c-bf1ea7045dc5 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650be3550>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:23.834696 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1af9628f-ba9b-4bc5-a60c-bf1ea7045dc5 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 200 len: 286 microversion: 2.1 time: 0.038777 May 12 14:48:23.835293 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 508/1022] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:23 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:24.848155 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a6655cef-d37f-4f32-a56a-f112bb9b6115 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650b78820>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:24.878122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a6655cef-d37f-4f32-a56a-f112bb9b6115 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 200 len: 286 microversion: 2.1 time: 0.034409 May 12 14:48:24.878716 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 515/1023] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:24 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:25.891456 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a3a31d90-5c7f-4848-8c6e-03f3e2e462d3 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650bda550>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:25.928715 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a3a31d90-5c7f-4848-8c6e-03f3e2e462d3 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 200 len: 286 microversion: 2.1 time: 0.042069 May 12 14:48:25.929298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 509/1024] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:25 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:26.944553 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fc6ec3e5-ee52-4ead-9d54-cc497c49a01d tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f46509779d0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:26.979486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fc6ec3e5-ee52-4ead-9d54-cc497c49a01d tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 200 len: 287 microversion: 2.1 time: 0.041842 May 12 14:48:26.980160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 516/1025] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:26 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:26.993782 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1165f212-6880-4eff-9fae-c96e34fcfd69 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650c02820>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:27.063636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1165f212-6880-4eff-9fae-c96e34fcfd69 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 202 len: 0 microversion: 2.1 time: 0.076230 May 12 14:48:27.068643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 510/1026] 10.222.0.79 () {58 vars in 1253 bytes} [Thu May 12 14:48:26 2022] DELETE /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:48:27.074048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b7ff1922-eea3-4c55-a965-6e7aa22bf3c7 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650977040>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:27.103834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b7ff1922-eea3-4c55-a965-6e7aa22bf3c7 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 200 len: 286 microversion: 2.1 time: 0.033570 May 12 14:48:27.104405 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 517/1027] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:27 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:28.121126 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ec07fd2a-7bb9-4187-b994-f1e9c504d973 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650b3e700>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:28.154978 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-ec07fd2a-7bb9-4187-b994-f1e9c504d973 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] HTTP exception thrown: Snapshot dbda7998-5afd-4879-9892-e15be474e0dd could not be found. May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ec07fd2a-7bb9-4187-b994-f1e9c504d973 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Request method failure captured: May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd HTTP/1.1 May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifR40Yd5bz3fHJBQQcfwsmMXUAJcDlVooVtglKB0aSTEhpOnNxJXmCPYQyzsTl51eR6xgWxz7JYn16R0VfxshPS7V6KGgrCGbkraULtvZsYZk1e-tFHaEH4yMcfbtR-X5x-XhJr6qhx1PeAJxj3lDshlwX2kl1RxPQO1vjeKRGGRrdIk May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:48:28.157720 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_024250b3c3f44403aa1ee20f63b1ed90", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: a59d9dff3aa142a481bb8b69c40228bf May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Snapshot dbda7998-5afd-4879-9892-e15be474e0dd could not be found. May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'dbda7998-5afd-4879-9892-e15be474e0dd'} May 12 14:48:28.159314 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dbda7998-5afd-4879-9892-e15be474e0dd could not be found. (HTTP 404) (Request-ID: req-174b31ad-e0bd-478b-af6c-c3d654bca25b) May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:28.160609 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:48:28.162017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dbda7998-5afd-4879-9892-e15be474e0dd could not be found. May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 14:48:28.163473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dbda7998-5afd-4879-9892-e15be474e0dd could not be found. May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dbda7998-5afd-4879-9892-e15be474e0dd could not be found. May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ec07fd2a-7bb9-4187-b994-f1e9c504d973 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Returning 404 to user: Snapshot dbda7998-5afd-4879-9892-e15be474e0dd could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:28.164920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ec07fd2a-7bb9-4187-b994-f1e9c504d973 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd" status: 404 len: 111 microversion: 2.1 time: 0.045386 May 12 14:48:28.165920 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 511/1028] 10.222.0.79 () {58 vars in 1250 bytes} [Thu May 12 14:48:28 2022] GET /compute/v2.1/os-snapshots/dbda7998-5afd-4879-9892-e15be474e0dd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:28.169192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fda9ac6b-8151-4e06-a976-b9402c789606 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650906160>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:28.239412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fda9ac6b-8151-4e06-a976-b9402c789606 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7" status: 202 len: 0 microversion: 2.1 time: 0.075255 May 12 14:48:28.240100 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 518/1029] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:48:28 2022] DELETE /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:48:28.248823 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-57eba1c7-6756-4c71-b71e-20f9b54fee85 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650b3e790>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:28.296922 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-57eba1c7-6756-4c71-b71e-20f9b54fee85 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7" status: 200 len: 345 microversion: 2.1 time: 0.051804 May 12 14:48:28.297493 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 512/1030] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:48:28 2022] GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:29.315552 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3ccf1008-c3d3-49b5-90e3-e8dfd2f0dc6a tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650906f70>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:29.343627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-3ccf1008-c3d3-49b5-90e3-e8dfd2f0dc6a tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] HTTP exception thrown: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3ccf1008-c3d3-49b5-90e3-e8dfd2f0dc6a tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Request method failure captured: May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 HTTP/1.1 May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifR40Yd5bz3fHJBQQcfwsmMXUAJcDlVooVtglKB0aSTEhpOnNxJXmCPYQyzsTl51eR6xgWxz7JYn16R0VfxshPS7V6KGgrCGbkraULtvZsYZk1e-tFHaEH4yMcfbtR-X5x-XhJr6qhx1PeAJxj3lDshlwX2kl1RxPQO1vjeKRGGRrdIk May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:48:29.345717 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_024250b3c3f44403aa1ee20f63b1ed90", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: a59d9dff3aa142a481bb8b69c40228bf May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7'} May 12 14:48:29.347665 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. (HTTP 404) (Request-ID: req-f6c16d4a-aed4-41da-87e6-ee23f24a2cf0) May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.348610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:48:29.349743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:48:29.351065 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3ccf1008-c3d3-49b5-90e3-e8dfd2f0dc6a tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Returning 404 to user: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3ccf1008-c3d3-49b5-90e3-e8dfd2f0dc6a tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7" status: 404 len: 109 microversion: 2.1 time: 0.039088 May 12 14:48:29.352527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 519/1031] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:48:29 2022] GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:29.362455 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1952ae49-446c-4ae0-befa-a29c314dbcd6 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f4650be34c0>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:29.394043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-1952ae49-446c-4ae0-befa-a29c314dbcd6 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] HTTP exception thrown: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1952ae49-446c-4ae0-befa-a29c314dbcd6 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Request method failure captured: May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 HTTP/1.1 May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifR40Yd5bz3fHJBQQcfwsmMXUAJcDlVooVtglKB0aSTEhpOnNxJXmCPYQyzsTl51eR6xgWxz7JYn16R0VfxshPS7V6KGgrCGbkraULtvZsYZk1e-tFHaEH4yMcfbtR-X5x-XhJr6qhx1PeAJxj3lDshlwX2kl1RxPQO1vjeKRGGRrdIk May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:48:29.396137 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_024250b3c3f44403aa1ee20f63b1ed90", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: a59d9dff3aa142a481bb8b69c40228bf May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7'} May 12 14:48:29.397662 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. (HTTP 404) (Request-ID: req-e9f1a3ba-d11b-48ba-85b3-b14a2950843c) May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.398566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:48:29.400035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 14:48:29.401507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1952ae49-446c-4ae0-befa-a29c314dbcd6 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Returning 404 to user: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:29.402894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1952ae49-446c-4ae0-befa-a29c314dbcd6 tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7" status: 404 len: 109 microversion: 2.1 time: 0.039439 May 12 14:48:29.403939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 513/1032] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:48:29 2022] DELETE /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:29.407251 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9ddce1bb-e044-4775-b1be-8197659f90fe tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Calling method '.version_select at 0x7f46508fa310>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:29.437283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-9ddce1bb-e044-4775-b1be-8197659f90fe tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] HTTP exception thrown: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9ddce1bb-e044-4775-b1be-8197659f90fe tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Request method failure captured: May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 HTTP/1.1 May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifR40Yd5bz3fHJBQQcfwsmMXUAJcDlVooVtglKB0aSTEhpOnNxJXmCPYQyzsTl51eR6xgWxz7JYn16R0VfxshPS7V6KGgrCGbkraULtvZsYZk1e-tFHaEH4yMcfbtR-X5x-XhJr6qhx1PeAJxj3lDshlwX2kl1RxPQO1vjeKRGGRrdIk May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:48:29.439336 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_024250b3c3f44403aa1ee20f63b1ed90", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/024250b3c3f44403aa1ee20f63b1ed90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 024250b3c3f44403aa1ee20f63b1ed90 May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1247732506 May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: a59d9dff3aa142a481bb8b69c40228bf May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1247732506-project May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7'} May 12 14:48:29.441304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. (HTTP 404) (Request-ID: req-0fb6e3ef-32d1-4ae2-af32-4ce8744a8722) May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.442309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:48:29.443527 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:48:29.444844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9ddce1bb-e044-4775-b1be-8197659f90fe tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] Returning 404 to user: Volume 36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9ddce1bb-e044-4775-b1be-8197659f90fe tempest-VolumesSnapshotsTestJSON-1247732506 tempest-VolumesSnapshotsTestJSON-1247732506-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7" status: 404 len: 109 microversion: 2.1 time: 0.038541 May 12 14:48:29.446034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 520/1033] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:48:29 2022] GET /compute/v2.1/os-volumes/36caddfe-dd2b-4c0f-aa6f-2e24311c6ce7 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:31.376657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-fdb0859c-d24f-4806-91d9-1f5f792c1c8e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:31.377762 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-fdb0859c-d24f-4806-91d9-1f5f792c1c8e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:31.384312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb0859c-d24f-4806-91d9-1f5f792c1c8e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:31.384745 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb0859c-d24f-4806-91d9-1f5f792c1c8e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:31.385506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb0859c-d24f-4806-91d9-1f5f792c1c8e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:31.385942 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-fdb0859c-d24f-4806-91d9-1f5f792c1c8e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:31.416676 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-fdb0859c-d24f-4806-91d9-1f5f792c1c8e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044177 May 12 14:48:31.417218 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 514/1034] 10.222.0.79 () {60 vars in 1342 bytes} [Thu May 12 14:48:31 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:31.474611 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:31.475087 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:31.481563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:31.481999 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:31.482754 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:31.483206 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:31.510844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:48:31.589242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7a383bec-5a51-4b37-b22e-70d154e7d846 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 204 len: 0 microversion: 2.20 time: 0.118778 May 12 14:48:31.590274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 521/1035] 10.222.0.79 () {60 vars in 1279 bytes} [Thu May 12 14:48:31 2022] DELETE /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:48:31.598747 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:31.599591 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:31.605779 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:31.606230 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:31.607014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:31.607451 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:31.746166 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:31.754496 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:31.756034 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:31.757256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1906c03f-69d0-4f0c-ba57-8c671afa5b07 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.162794 May 12 14:48:31.757822 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 515/1036] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:31 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:48:32.776694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:32.777399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:32.784034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.784491 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.785819 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.786067 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.930856 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:32.939540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:32.941272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:32.942614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c4ef978f-ca38-4ffd-9c4f-325a020f968d tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.170303 May 12 14:48:32.943409 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 522/1037] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:32 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:48:33.961693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:33.962285 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:33.969436 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:33.969879 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:33.970646 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:33.971074 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:34.223397 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:34.232883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:34.234638 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:34.236007 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-df164445-046b-4cc7-83c4-ce7669587a7f tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1724 microversion: 2.20 time: 0.278371 May 12 14:48:34.240039 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 516/1038] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:33 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:48:34.694370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-909665f2-ef6e-4676-b88d-2da2e1ee5d07 req-a04a412b-54df-41da-a23a-81076f342d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf6710-d383-4d92-8328-2812361411a4", "name": "network-vif-deleted", "tag": "a6930fb7-573c-4eee-bf16-c9de09bd6eb3"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:34.705489 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-909665f2-ef6e-4676-b88d-2da2e1ee5d07 req-a04a412b-54df-41da-a23a-81076f342d03 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:34.706024 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-909665f2-ef6e-4676-b88d-2da2e1ee5d07 req-a04a412b-54df-41da-a23a-81076f342d03 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:34.719208 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-909665f2-ef6e-4676-b88d-2da2e1ee5d07 req-a04a412b-54df-41da-a23a-81076f342d03 service nova] Creating event network-vif-deleted:a6930fb7-573c-4eee-bf16-c9de09bd6eb3 for instance 05cf6710-d383-4d92-8328-2812361411a4 on hv-cinder-84067 May 12 14:48:34.724926 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-909665f2-ef6e-4676-b88d-2da2e1ee5d07 req-a04a412b-54df-41da-a23a-81076f342d03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035435 May 12 14:48:34.725556 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 523/1039] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:35.254999 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:35.255614 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:35.262649 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:35.263109 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:35.264155 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:35.264635 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:35.298642 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:35.299089 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:35.299541 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'fault' on Instance uuid 05cf6710-d383-4d92-8328-2812361411a4 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:35.342245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:35.350468 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:35.351993 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:35.353162 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5ea08d52-bf5e-4bf8-9317-b9146548755e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1371 microversion: 2.20 time: 0.102419 May 12 14:48:35.353726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 517/1040] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:35 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:48:36.377362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:36.378667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:36.389668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:36.390404 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:36.391668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:36.392429 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:36.423791 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:36.424233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:36.424680 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'fault' on Instance uuid 05cf6710-d383-4d92-8328-2812361411a4 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:36.472752 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:36.480911 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:36.482406 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:36.483586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f785ae85-8e9f-4513-b379-9cfa922d4a65 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1371 microversion: 2.20 time: 0.113398 May 12 14:48:36.484145 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 524/1041] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:36 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:48:37.504798 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:37.505392 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:37.512035 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:37.512479 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:37.513256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:37.513688 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:37.544340 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:37.544777 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:37.545221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'fault' on Instance uuid 05cf6710-d383-4d92-8328-2812361411a4 {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:37.594457 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:37.602791 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:37.604327 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:37.605486 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c53c010b-013b-4632-b7d8-abc9bb04ad7e tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1371 microversion: 2.20 time: 0.107049 May 12 14:48:37.606047 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 518/1042] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:37 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:48:38.627720 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:38.629497 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:38.640504 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:38.641239 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:38.642498 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:38.643208 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:38.676425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:38.676871 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:38.677316 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lazy-loading 'fault' on Instance uuid 05cf6710-d383-4d92-8328-2812361411a4 {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:38.725788 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:38.736238 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:38.737770 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7b41d1655e24cf0b1f4bda137115af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd7bf482a7c472bbe4857f2d71d00e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:38.740025 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-871bd639-3f7b-4e7d-aa52-f7e6d8a6b33a tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 200 len: 1371 microversion: 2.20 time: 0.118489 May 12 14:48:38.740547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 525/1043] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:38 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:48:39.759552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:39.760387 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:39.766574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:39.767019 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:39.767824 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:39.768264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:39.785695 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] HTTP exception thrown: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Request method failure captured: May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 HTTP/1.1 May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu83aNfYPV8dh6RtPL6o2DKCTRVBkMSKxff94Xdz7iYUpiyalaRdLwoR92YlczE59qMZ1u_FHQEvr_ZhdaIg_k0aZD-oIi0BFztcwApg4J7QecGtyxCLYCv6D4W-KM3J_OvSLALGuZpldAqVSGRH-16INbnORPcvhmUPSpLfbfF2nY May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:48:39.787277 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0dd7bf482a7c472bbe4857f2d71d00e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: f7b41d1655e24cf0b1f4bda137115af4 May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:39.788986 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '05cf6710-d383-4d92-8328-2812361411a4'} May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:39.789866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:39.791667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:39.793005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Returning 404 to user: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:39.793005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-db91b15e-1673-4786-93a9-10cca019272c tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 404 len: 111 microversion: 2.20 time: 0.034137 May 12 14:48:39.793005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 519/1044] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:39 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:48:39.798522 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ba046c40-de57-4133-be16-93f6f4edb7a4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '.version_select at 0x7f4650b78160>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:39.820172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ba046c40-de57-4133-be16-93f6f4edb7a4 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909760855" status: 204 len: 0 microversion: 2.20 time: 0.025224 May 12 14:48:39.823198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 526/1045] 10.222.0.79 () {60 vars in 1261 bytes} [Thu May 12 14:48:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909760855 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:48:41.625440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:41.625936 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:41.632618 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.633054 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.633805 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.634230 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.647707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] HTTP exception thrown: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Request method failure captured: May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 HTTP/1.1 May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu83aNfYPV8dh6RtPL6o2DKCTRVBkMSKxff94Xdz7iYUpiyalaRdLwoR92YlczE59qMZ1u_FHQEvr_ZhdaIg_k0aZD-oIi0BFztcwApg4J7QecGtyxCLYCv6D4W-KM3J_OvSLALGuZpldAqVSGRH-16INbnORPcvhmUPSpLfbfF2nY May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:48:41.649248 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0dd7bf482a7c472bbe4857f2d71d00e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: f7b41d1655e24cf0b1f4bda137115af4 May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.650939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '05cf6710-d383-4d92-8328-2812361411a4'} May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:41.652048 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.653606 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:41.655221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Returning 404 to user: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:41.655221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-79537809-cbbb-4ce2-ad24-4a928bf32e52 tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 404 len: 111 microversion: 2.20 time: 0.029070 May 12 14:48:41.655221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 520/1046] 10.222.0.79 () {60 vars in 1279 bytes} [Thu May 12 14:48:41 2022] DELETE /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:48:41.659585 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:41.660221 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 05cf6710-d383-4d92-8328-2812361411a4] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:41.667511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.667992 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.668761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.669193 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.682538 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] HTTP exception thrown: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Request method failure captured: May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 HTTP/1.1 May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu83aNfYPV8dh6RtPL6o2DKCTRVBkMSKxff94Xdz7iYUpiyalaRdLwoR92YlczE59qMZ1u_FHQEvr_ZhdaIg_k0aZD-oIi0BFztcwApg4J7QecGtyxCLYCv6D4W-KM3J_OvSLALGuZpldAqVSGRH-16INbnORPcvhmUPSpLfbfF2nY May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:48:41.684289 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0dd7bf482a7c472bbe4857f2d71d00e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: f7b41d1655e24cf0b1f4bda137115af4 May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.685930 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '05cf6710-d383-4d92-8328-2812361411a4'} May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:41.686866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. May 12 14:48:41.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:41.689834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Returning 404 to user: Instance 05cf6710-d383-4d92-8328-2812361411a4 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:41.689834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4b98535a-a6c4-4ff3-be4d-11bdb8d455ae tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4" status: 404 len: 111 microversion: 2.20 time: 0.030527 May 12 14:48:41.689834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 527/1047] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:41 2022] GET /compute/v2.1/servers/05cf6710-d383-4d92-8328-2812361411a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 14:48:42.828754 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:42.829222 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:42.835950 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:42.836397 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:42.837174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:42.837605 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:42.857385 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] HTTP exception thrown: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Request method failure captured: May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 HTTP/1.1 May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu83aNfYPV8dh6RtPL6o2DKCTRVBkMSKxff94Xdz7iYUpiyalaRdLwoR92YlczE59qMZ1u_FHQEvr_ZhdaIg_k0aZD-oIi0BFztcwApg4J7QecGtyxCLYCv6D4W-KM3J_OvSLALGuZpldAqVSGRH-16INbnORPcvhmUPSpLfbfF2nY May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:48:42.858961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0dd7bf482a7c472bbe4857f2d71d00e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: f7b41d1655e24cf0b1f4bda137115af4 May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.860516 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '1dbaf2e7-9702-48d5-8a0e-5088f269f7f1'} May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:42.861258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.862547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:48:42.863830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Returning 404 to user: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:42.863830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-781ac133-00a7-4c9d-a1a1-c50bd0bd37fe tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 404 len: 111 microversion: 2.20 time: 0.035845 May 12 14:48:42.863830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 521/1048] 10.222.0.79 () {60 vars in 1279 bytes} [Thu May 12 14:48:42 2022] DELETE /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:48:42.869487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:42.870123 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] [instance: 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:42.877140 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:42.877456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:42.878454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:42.878755 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:42.892853 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] HTTP exception thrown: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Request method failure captured: May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 HTTP/1.1 May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu83aNfYPV8dh6RtPL6o2DKCTRVBkMSKxff94Xdz7iYUpiyalaRdLwoR92YlczE59qMZ1u_FHQEvr_ZhdaIg_k0aZD-oIi0BFztcwApg4J7QecGtyxCLYCv6D4W-KM3J_OvSLALGuZpldAqVSGRH-16INbnORPcvhmUPSpLfbfF2nY May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:48:42.894412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0dd7bf482a7c472bbe4857f2d71d00e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0dd7bf482a7c472bbe4857f2d71d00e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 0dd7bf482a7c472bbe4857f2d71d00e1 May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1991638474 May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: f7b41d1655e24cf0b1f4bda137115af4 May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1991638474-project May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.896141 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '1dbaf2e7-9702-48d5-8a0e-5088f269f7f1'} May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:42.897322 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. May 12 14:48:42.898813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:48:42.900227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] Returning 404 to user: Instance 1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:42.900227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f819fcc9-6314-48e9-91d8-35c8dca566dd tempest-AttachVolumeShelveTestJSON-1991638474 tempest-AttachVolumeShelveTestJSON-1991638474-project] 10.222.0.79 "GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1" status: 404 len: 111 microversion: 2.20 time: 0.030650 May 12 14:48:42.900227 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 528/1049] 10.222.0.79 () {60 vars in 1276 bytes} [Thu May 12 14:48:42 2022] GET /compute/v2.1/servers/1dbaf2e7-9702-48d5-8a0e-5088f269f7f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:49:20.147461 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c5e07f93-1edc-460a-874e-356169eb29bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:20.148032 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c5e07f93-1edc-460a-874e-356169eb29bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:20.154394 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c5e07f93-1edc-460a-874e-356169eb29bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:20.154883 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c5e07f93-1edc-460a-874e-356169eb29bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:20.155640 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c5e07f93-1edc-460a-874e-356169eb29bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:20.156103 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c5e07f93-1edc-460a-874e-356169eb29bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:20.179384 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c5e07f93-1edc-460a-874e-356169eb29bd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/ips" status: 200 len: 151 microversion: 2.1 time: 0.249419 May 12 14:49:20.179974 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 522/1050] 10.222.0.79 () {58 vars in 1247 bytes} [Thu May 12 14:49:19 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/ips => generated 151 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:21.511194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a3fee60f-b380-4491-b8c1-112935dc4cce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "477e0794-f4de-430e-a9be-73b40c131fba"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:21.512418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a3fee60f-b380-4491-b8c1-112935dc4cce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:21.518474 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3fee60f-b380-4491-b8c1-112935dc4cce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:21.518937 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3fee60f-b380-4491-b8c1-112935dc4cce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:21.519720 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3fee60f-b380-4491-b8c1-112935dc4cce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:21.520177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a3fee60f-b380-4491-b8c1-112935dc4cce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:21.799335 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a3fee60f-b380-4491-b8c1-112935dc4cce tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "POST /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292196 May 12 14:49:21.800132 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 529/1051] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:49:21 2022] POST /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:31.572412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:31.572982 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:31.580349 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:31.581123 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:31.581885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:31.582321 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:31.664693 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lazy-loading 'services' on Instance uuid e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:49:31.746086 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-75a1aa07-a9d6-4d32-81f5-595dd6d4e56c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments/477e0794-f4de-430e-a9be-73b40c131fba" status: 202 len: 0 microversion: 2.1 time: 0.179622 May 12 14:49:31.746683 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 523/1052] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:49:31 2022] DELETE /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments/477e0794-f4de-430e-a9be-73b40c131fba => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:49:31.756707 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3d0d4a71-f954-4afa-a29e-d3c979afb345 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:31.757789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3d0d4a71-f954-4afa-a29e-d3c979afb345 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:31.764050 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a71-f954-4afa-a29e-d3c979afb345 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:31.764533 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a71-f954-4afa-a29e-d3c979afb345 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:31.765416 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a71-f954-4afa-a29e-d3c979afb345 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:31.765857 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a71-f954-4afa-a29e-d3c979afb345 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:31.799153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3d0d4a71-f954-4afa-a29e-d3c979afb345 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047742 May 12 14:49:31.799722 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 530/1053] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:49:31 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:32.811728 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-811f35c6-ce8f-42cd-8575-33e429fe5d48 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:32.812872 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-811f35c6-ce8f-42cd-8575-33e429fe5d48 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:32.819517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-811f35c6-ce8f-42cd-8575-33e429fe5d48 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:32.820270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-811f35c6-ce8f-42cd-8575-33e429fe5d48 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:32.821077 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-811f35c6-ce8f-42cd-8575-33e429fe5d48 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:32.821515 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-811f35c6-ce8f-42cd-8575-33e429fe5d48 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:32.856256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-811f35c6-ce8f-42cd-8575-33e429fe5d48 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049339 May 12 14:49:32.856913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 524/1054] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:49:32 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:33.869511 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c193875a-9072-4cc0-bc58-746baeeaba87 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:33.870444 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c193875a-9072-4cc0-bc58-746baeeaba87 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:33.877301 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c193875a-9072-4cc0-bc58-746baeeaba87 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:33.877746 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c193875a-9072-4cc0-bc58-746baeeaba87 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:33.878517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c193875a-9072-4cc0-bc58-746baeeaba87 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:33.878947 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c193875a-9072-4cc0-bc58-746baeeaba87 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:33.908268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c193875a-9072-4cc0-bc58-746baeeaba87 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042763 May 12 14:49:33.908742 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 531/1055] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:49:33 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:49:33.969471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:33.970005 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:33.979923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:33.980375 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:33.981153 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:33.981754 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:34.009748 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:49:34.089031 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-921b4d18-ea34-4eda-922a-ad981d44abc9 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 204 len: 0 microversion: 2.1 time: 0.125378 May 12 14:49:34.089856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 525/1056] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:49:33 2022] DELETE /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:49:34.098510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:34.099408 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:34.105485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:34.105967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:34.106737 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:34.107169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:34.249217 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:34.257593 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-43a13b37-9722-4db6-830d-c529279f7363 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1683 microversion: 2.1 time: 0.163066 May 12 14:49:34.258306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 532/1057] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:34 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:35.280282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:35.280969 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:35.288011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:35.288465 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:35.289242 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:35.289675 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:35.424579 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:35.432440 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-f4f537ce-60e4-4941-a4ec-a513f5af5163 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1683 microversion: 2.1 time: 0.156466 May 12 14:49:35.433021 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 526/1058] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:35 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:36.449545 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:36.450138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:36.456552 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:36.456996 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:36.457769 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:36.458272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:36.702324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:36.711006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b4eb3724-70de-4035-9e74-4a5c64a7a09a tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1683 microversion: 2.1 time: 0.265368 May 12 14:49:36.711998 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 533/1059] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:36 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1683 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:37.336157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:49:37.336734 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 14:49:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:49:37.515663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-7b7d81d3-5e06-4c82-bfda-8170afc88409 req-5955ed0e-a6ea-468d-b792-da57f861e73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc", "name": "network-vif-deleted", "tag": "027da599-4cf6-4e03-9ae4-24ae61e29323"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:37.527246 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-7b7d81d3-5e06-4c82-bfda-8170afc88409 req-5955ed0e-a6ea-468d-b792-da57f861e73d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:37.528895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-7b7d81d3-5e06-4c82-bfda-8170afc88409 req-5955ed0e-a6ea-468d-b792-da57f861e73d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:37.553479 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-7b7d81d3-5e06-4c82-bfda-8170afc88409 req-5955ed0e-a6ea-468d-b792-da57f861e73d service nova] Creating event network-vif-deleted:027da599-4cf6-4e03-9ae4-24ae61e29323 for instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc on hv-cinder-84067 May 12 14:49:37.560674 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-7b7d81d3-5e06-4c82-bfda-8170afc88409 req-5955ed0e-a6ea-468d-b792-da57f861e73d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182879 May 12 14:49:37.563636 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 527/1060] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:37.728982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:37.729558 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:37.737444 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:37.737907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:37.738772 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:37.739231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:37.773699 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:37.774242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:37.774767 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lazy-loading 'fault' on Instance uuid e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:49:37.849947 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab522f0209154f959a431caa01f3a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9794155ca0aa4b75a153f0640e068ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:37.857392 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1f5334f8-c2bf-4045-9d61-71482b8199fd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 200 len: 1332 microversion: 2.1 time: 0.132632 May 12 14:49:37.868462 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 534/1061] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:37 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:38.876309 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:38.877011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:38.883928 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:38.884371 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:38.885134 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:38.885585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:38.899220 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc HTTP/1.1 May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:49:38.900947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:38.902643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc'} May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:38.907040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:38.908664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:38.910175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:38.910175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-45a8560d-a112-4fc1-8d8d-0c051c63a95b tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 404 len: 111 microversion: 2.1 time: 0.030977 May 12 14:49:38.910175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 528/1062] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:38 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:38.911343 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-602f7044-4c15-430d-b58f-b60cc06d1ef0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '.version_select at 0x7f4650a9a670>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:38.931607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-602f7044-4c15-430d-b58f-b60cc06d1ef0 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899728889" status: 202 len: 0 microversion: 2.1 time: 0.024025 May 12 14:49:38.932233 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 535/1063] 10.222.0.79 () {58 vars in 1220 bytes} [Thu May 12 14:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899728889 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:49:40.724543 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:40.725184 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:40.732040 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:40.732454 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:40.733450 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:40.733882 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:40.748373 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc HTTP/1.1 May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:49:40.749971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.751834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc'} May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:40.752818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.754757 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:40.756231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:40.756231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6a9255a7-3631-4f74-b2c2-34982286c162 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 404 len: 111 microversion: 2.1 time: 0.030833 May 12 14:49:40.756231 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 529/1064] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:49:40 2022] DELETE /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:40.761823 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:40.762431 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:40.769448 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:40.769889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:40.770653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:40.771081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:40.792243 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc HTTP/1.1 May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:49:40.795059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.796749 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc'} May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:40.797599 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. May 12 14:49:40.798865 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:40.799995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:40.799995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9b979e28-f8f2-47e1-91f9-a7ac030afecc tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc" status: 404 len: 111 microversion: 2.1 time: 0.040331 May 12 14:49:40.799995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 536/1065] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:40 2022] GET /compute/v2.1/servers/e3d93354-29fd-4c3b-8cdd-46a1ad6b65fc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:41.943093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:41.943674 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:41.950167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:41.950613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:41.951400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:41.951866 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:41.972288 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e HTTP/1.1 May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:49:41.973862 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:41.975256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e'} May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:41.976282 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:41.978052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:41.980312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:41.980312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7dbb9ee8-acf5-4f43-8519-c6979ee3776c tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 404 len: 111 microversion: 2.1 time: 0.036086 May 12 14:49:41.980312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 530/1066] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:49:41 2022] DELETE /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:41.986075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:41.986668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:41.993764 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:41.994306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:41.995166 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:41.995895 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:42.010492 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e HTTP/1.1 May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:49:42.011787 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:42.013284 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e'} May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:42.014014 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. May 12 14:49:42.015236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.017576 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:42.028160 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e2102187-ddc0-492e-a7e8-3ed46f7a3d96 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e" status: 404 len: 111 microversion: 2.1 time: 0.046219 May 12 14:49:42.029320 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 537/1067] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:41 2022] GET /compute/v2.1/servers/feb93e3a-a7a0-401d-a3cb-e35dfaf73f0e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:42.039708 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:42.040518 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:42.047283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:42.048081 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:42.049202 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:42.050528 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:42.065458 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad HTTP/1.1 May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:49:42.067280 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.069059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': '42c58127-4521-4c68-b19f-9a016a0f3aad'} May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:42.070213 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.072046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:42.073335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:42.073335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-975f089a-62b0-49f4-b0e7-ce92d58e93ae tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 404 len: 111 microversion: 2.1 time: 0.034549 May 12 14:49:42.073335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 531/1068] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:49:42 2022] DELETE /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:49:42.077804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:42.078643 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: 42c58127-4521-4c68-b19f-9a016a0f3aad] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:42.084725 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:42.085366 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:42.086519 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:42.087212 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:42.102183 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad HTTP/1.1 May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:49:42.103907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.105246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': '42c58127-4521-4c68-b19f-9a016a0f3aad'} May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:42.105981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. May 12 14:49:42.107179 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:42.108468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance 42c58127-4521-4c68-b19f-9a016a0f3aad could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:42.108468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-43d06ba5-ad7d-41bd-9e73-c063734ab196 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad" status: 404 len: 111 microversion: 2.1 time: 0.031433 May 12 14:49:42.108468 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 538/1069] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:42 2022] GET /compute/v2.1/servers/42c58127-4521-4c68-b19f-9a016a0f3aad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:49.560407 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:49.560972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:49.567714 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:49.568156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:49.568923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:49.569358 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:49.585013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: DELETE /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 HTTP/1.1 May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:49:49.586548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.588217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'e98650df-7034-4d31-ad93-f9a133863781'} May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:49.589156 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.590830 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:49:49.592786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:49.592786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-87ad7387-721a-4493-8a67-3b3fd1974fcd tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 404 len: 111 microversion: 2.1 time: 0.031966 May 12 14:49:49.592786 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 532/1070] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:49:49 2022] DELETE /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:49.596522 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:49.597134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] [instance: e98650df-7034-4d31-ad93-f9a133863781] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:49:49.603544 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:49.604236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:49.605005 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:49:49.605434 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:49:49.618768 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] HTTP exception thrown: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Request method failure captured: May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 HTTP/1.1 May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifRu1EHU6BLkfLOBGkk2JuL3H4QP6VyJF347UdFMVl0vZjI1nVsmv0oTWmkPkqln5XNGV4PxwAeWxb3OfTe7MaLfEDBeJ6T36q7xeR75OJiF1CaxY6xAki9PAd6qCAYNZF5aCSYGK1YuRCnjhsPHx5Zac1O7QQdnY1rjoBkC0CcXTo9I May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:49:49.620985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9794155ca0aa4b75a153f0640e068ff5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9794155ca0aa4b75a153f0640e068ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 9794155ca0aa4b75a153f0640e068ff5 May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445798165 May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: ab522f0209154f959a431caa01f3a029 May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-AttachVolumeNegativeTest-1445798165-project May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.622529 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'e98650df-7034-4d31-ad93-f9a133863781'} May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:49:49.623589 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. May 12 14:49:49.625106 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:49:49.626844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] Returning 404 to user: Instance e98650df-7034-4d31-ad93-f9a133863781 could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:49:49.626844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-02d92a65-b677-488f-80e0-9f44095147f7 tempest-AttachVolumeNegativeTest-1445798165 tempest-AttachVolumeNegativeTest-1445798165-project] 10.222.0.79 "GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781" status: 404 len: 111 microversion: 2.1 time: 0.029700 May 12 14:49:49.626844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 539/1071] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:49:49 2022] GET /compute/v2.1/servers/e98650df-7034-4d31-ad93-f9a133863781 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:49:58.959940 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-532c3749-0f58-4ab6-aa78-08217665af1a tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650c728b0>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:59.012296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-532c3749-0f58-4ab6-aa78-08217665af1a tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/1dbfed95-6e2f-477c-b32a-2a40a33230b1" status: 200 len: 351 microversion: 2.1 time: 0.056127 May 12 14:49:59.012849 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 533/1072] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:49:58 2022] GET /compute/v2.1/os-volumes/1dbfed95-6e2f-477c-b32a-2a40a33230b1 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:00.343042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-248fc5ee-3146-49de-a3e0-920f28a6ff84 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650a8cee0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:00.391213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-248fc5ee-3146-49de-a3e0-920f28a6ff84 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/50ef41f9-9686-440f-86ff-26c6d2a73c55" status: 200 len: 351 microversion: 2.1 time: 0.052258 May 12 14:50:00.391988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 540/1073] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:50:00 2022] GET /compute/v2.1/os-volumes/50ef41f9-9686-440f-86ff-26c6d2a73c55 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:01.723445 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-97c13234-2088-4da5-ae0b-2c92a4ee0f9a tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650ac09d0>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:01.777581 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-97c13234-2088-4da5-ae0b-2c92a4ee0f9a tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/f6394d19-1c51-4b77-a964-d7df73e1636f" status: 200 len: 351 microversion: 2.1 time: 0.060868 May 12 14:50:01.778275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 534/1074] 10.222.0.79 () {58 vars in 1244 bytes} [Thu May 12 14:50:01 2022] GET /compute/v2.1/os-volumes/f6394d19-1c51-4b77-a964-d7df73e1636f => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:01.792736 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8aca77b1-5ead-4cd6-9efd-0a17a4301c5a tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650a0a3a0>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:01.879878 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8aca77b1-5ead-4cd6-9efd-0a17a4301c5a tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.093183 May 12 14:50:01.880470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 541/1075] 10.222.0.79 () {58 vars in 1133 bytes} [Thu May 12 14:50:01 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:01.892767 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a0b7da8c-84db-447f-beae-81dea5f46912 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650bda310>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:01.978520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a0b7da8c-84db-447f-beae-81dea5f46912 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089190 May 12 14:50:01.979300 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 535/1076] 10.222.0.79 () {58 vars in 1148 bytes} [Thu May 12 14:50:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:01.991971 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b0743018-e14f-452d-bc0c-feed25fb09b0 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650b9b940>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:02.073362 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b0743018-e14f-452d-bc0c-feed25fb09b0 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085545 May 12 14:50:02.073939 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 542/1077] 10.222.0.79 () {58 vars in 1133 bytes} [Thu May 12 14:50:01 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:02.086126 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9d5f86da-ed6e-458f-9696-5bca6ad97795 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650bda430>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:02.166437 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9d5f86da-ed6e-458f-9696-5bca6ad97795 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084077 May 12 14:50:02.167543 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 536/1078] 10.222.0.79 () {58 vars in 1166 bytes} [Thu May 12 14:50:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:02.180271 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-121a53df-5df4-4cdc-8592-2ada75b2a3d5 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f46509a9b80>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:02.271991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-121a53df-5df4-4cdc-8592-2ada75b2a3d5 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.095373 May 12 14:50:02.272582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 543/1079] 10.222.0.79 () {58 vars in 1169 bytes} [Thu May 12 14:50:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:02.285275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a49ccd71-ccbc-4fa4-85ff-332427bc5355 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650c02160>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:02.383303 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a49ccd71-ccbc-4fa4-85ff-332427bc5355 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.101628 May 12 14:50:02.383802 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 537/1080] 10.222.0.79 () {58 vars in 1154 bytes} [Thu May 12 14:50:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:02.396766 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d9ccd717-0497-4525-ba47-67f62a565364 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650a8cd30>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:02.488059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d9ccd717-0497-4525-ba47-67f62a565364 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095441 May 12 14:50:02.488646 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 544/1081] 10.222.0.79 () {58 vars in 1187 bytes} [Thu May 12 14:50:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:02.501360 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-103f3a77-768b-497a-8969-3bf29984f946 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] Calling method '.version_select at 0x7f4650c72d30>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:02.599907 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-103f3a77-768b-497a-8969-3bf29984f946 tempest-VolumesTestJSON-2092248911 tempest-VolumesTestJSON-2092248911-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.103028 May 12 14:50:02.600813 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 538/1082] 10.222.0.79 () {58 vars in 1154 bytes} [Thu May 12 14:50:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:11.507855 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:51:11.508694 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 14:51:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:52:33.298018 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:52:33.301969 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-408909fe-948a-415b-ba6d-1ec268c3196a tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Action: 'create', calling method: .version_select at 0x7f46509a9e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-886522403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdmuzNfauvF/H4XnuioosNs0dE/Q92a5GQw+AoApdNjMJy2R2P9UbrakZNobMjSYoQv5tfG895o/7QSNhpgf8rKqH2am4pEudLOlKAmPW/ASwMlqODL4h2Ro++S92EoRQ=="}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:33.316207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-408909fe-948a-415b-ba6d-1ec268c3196a tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Getting quotas for project 7557d7be043140c29f88052c05ba38be. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:52:33.320473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-408909fe-948a-415b-ba6d-1ec268c3196a tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Getting quotas for user cbe380821fbb421483675afa367066c5 and project 7557d7be043140c29f88052c05ba38be. Resources: {'key_pairs'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:52:33.332244 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [None req-408909fe-948a-415b-ba6d-1ec268c3196a tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [4aa300f6-437e-4378-bcc1-87dfa77e7aa9] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:52:33.740503 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:52:33.741439 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 14:52:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:52:34.307510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35288. May 12 14:52:34.340037 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [None req-408909fe-948a-415b-ba6d-1ec268c3196a tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [4aa300f6-437e-4378-bcc1-87dfa77e7aa9] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35290. May 12 14:52:34.356640 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-408909fe-948a-415b-ba6d-1ec268c3196a tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.060393 May 12 14:52:34.357253 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 545/1083] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:52:33 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:34.405234 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb9f0ee6-ba6e-4c56-93c9-40370716aeaa] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:52:34.409205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1932616482", "imageRef": "3e381938-febc-4744-b58e-330e0ab0e536", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-886522403", "networks": [{"uuid": "31b1b269-5ab5-4250-8f13-746c571cce8f"}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:34.616470 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] validate_networks() for [('31b1b269-5ab5-4250-8f13-746c571cce8f', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:52:35.120697 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:52:35.121283 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:52:35.121696 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:52:35.122267 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:52:35.122869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:52:35.137518 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:35.137964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:35.139190 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:35.139769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:35.162421 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Getting quotas for project 7557d7be043140c29f88052c05ba38be. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:52:35.166367 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Getting quotas for user cbe380821fbb421483675afa367066c5 and project 7557d7be043140c29f88052c05ba38be. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:52:35.178228 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:52:35.180575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3e381938-febc-4744-b58e-330e0ab0e536',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:52:35.238630 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-77aad5f3-f886-4fdc-8a76-48f3685613f1 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834985 May 12 14:52:35.239352 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 539/1084] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:52:35.249615 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4a659ef7-10a6-44b2-a651-76dd900da1de tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:35.250237 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4a659ef7-10a6-44b2-a651-76dd900da1de tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:35.371133 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4a659ef7-10a6-44b2-a651-76dd900da1de tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:35.378691 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4a659ef7-10a6-44b2-a651-76dd900da1de tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1258 microversion: 2.1 time: 0.133157 May 12 14:52:35.379272 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 546/1085] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:35 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1258 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:36.397153 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1950ffd4-d076-4814-820f-377ad4586d8b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:36.397864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1950ffd4-d076-4814-820f-377ad4586d8b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:36.414342 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb9f0ee6-ba6e-4c56-93c9-40370716aeaa] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35328. May 12 14:52:36.459669 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1950ffd4-d076-4814-820f-377ad4586d8b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:36.466631 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1950ffd4-d076-4814-820f-377ad4586d8b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1258 microversion: 2.1 time: 0.074210 May 12 14:52:36.467139 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 540/1086] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:36 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:37.487961 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bf051d06-0b44-429c-a245-cb0583c10154 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:37.489207 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bf051d06-0b44-429c-a245-cb0583c10154 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:37.544444 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-bf051d06-0b44-429c-a245-cb0583c10154 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:37.551178 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bf051d06-0b44-429c-a245-cb0583c10154 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1258 microversion: 2.1 time: 0.070172 May 12 14:52:37.551937 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 547/1087] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:37 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:38.571717 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c697f9bf-cd69-4009-bbc1-cb588f58aaf3 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:38.572343 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c697f9bf-cd69-4009-bbc1-cb588f58aaf3 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:38.633369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c697f9bf-cd69-4009-bbc1-cb588f58aaf3 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:38.640626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c697f9bf-cd69-4009-bbc1-cb588f58aaf3 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1258 microversion: 2.1 time: 0.074377 May 12 14:52:38.641426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 541/1088] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:38 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:39.662869 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:39.664276 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:39.676217 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:39.677031 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:39.678238 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:39.678981 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:39.741523 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:39.749857 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-08969308-300d-4826-bc36-6de3045f1dab tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1262 microversion: 2.1 time: 0.093698 May 12 14:52:39.750520 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 548/1089] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:39 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:40.767514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:40.768238 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:40.776967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:40.777423 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:40.779076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:40.779513 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:40.865362 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:40.873253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e96e7954-96f3-4f1c-86d1-e6cc14e07710 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1316 microversion: 2.1 time: 0.110198 May 12 14:52:40.874181 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 542/1090] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:40 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1316 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:41.891177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:41.891830 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:41.898476 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:41.898931 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:41.899916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:41.900367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:42.041374 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:42.049239 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-95cc52a6-6197-499f-950a-fcf1512e3905 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.162525 May 12 14:52:42.049806 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 549/1091] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:41 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:43.068544 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:43.069325 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:43.077059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:43.077433 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:43.078195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:43.078616 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:43.224186 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:43.232218 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c3480f27-4169-47d9-9970-49dc8ee817b4 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.168903 May 12 14:52:43.232821 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 543/1092] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:43 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:44.252455 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:44.253043 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:44.260623 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:44.261075 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:44.261915 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:44.262346 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:44.452216 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:44.460516 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fa6504c6-15ef-4893-8c1f-b15186ccb63f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.214323 May 12 14:52:44.461093 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 550/1093] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:44 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:45.479165 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:45.479795 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:45.487076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:45.487612 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:45.488770 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:45.489271 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:45.636849 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:45.649172 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c70847bc-9025-40dc-bd35-e84781e33385 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.174240 May 12 14:52:45.650221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 544/1094] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:45 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:46.675628 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:46.676928 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:46.688305 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:46.689044 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:46.690315 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:46.691033 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:46.828837 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:46.861153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ea7d21f0-4d40-4f59-9130-86e5086af229 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.178186 May 12 14:52:46.861153 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 551/1095] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:46 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:47.874514 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:47.875093 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:47.882996 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:47.883443 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:47.884255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:47.884687 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:48.035948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:48.045698 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-81137177-a96c-44bd-81e4-57f5e2a72f42 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.175169 May 12 14:52:48.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 545/1096] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:47 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:49.062694 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:49.063373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:49.070169 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:49.070622 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:49.071386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:49.072619 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:49.226526 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:49.233841 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b1973ccd-b654-4c98-8bb4-163d51dbf75b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.175173 May 12 14:52:49.234412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 552/1097] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:49 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:50.250859 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:50.251596 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:50.258078 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:50.258519 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:50.259296 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:50.259737 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:50.423633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:50.431002 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-65268cf9-f1c2-44c9-a83d-8cf733a2f377 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.184181 May 12 14:52:50.431573 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 546/1098] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:50 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:51.453249 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:51.454299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:51.464924 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:51.465652 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:51.466613 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:51.467049 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:51.603586 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:51.615051 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3b1ab3d9-4b33-4578-84bf-d4e3109b9321 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.168654 May 12 14:52:51.615867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 553/1099] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:51 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:52.638214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:52.639096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:52.646017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:52.646467 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:52.647234 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:52.647665 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:52.786620 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:52.794405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-af68fa12-950e-4b8f-a0f8-41a436f8f6a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.162506 May 12 14:52:52.794966 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 547/1100] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:52 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:53.810631 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:53.811312 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:53.817726 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:53.818173 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:53.818921 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:53.819353 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:54.057510 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:54.065391 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-93174c31-031a-487c-b1a1-7e0909339501 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.258682 May 12 14:52:54.065992 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 554/1101] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:53 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:54.786295 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-5b4ed62a-cdd2-4c0d-9bed-68fb5f827f9b req-58bb15da-096c-4eff-a65d-06d9df5c2be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ecd861-42ce-4f1a-9367-4aee35de209f", "tag": "936e6a70-382e-4a7b-b0f3-253ad9d29445"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:54.796953 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-5b4ed62a-cdd2-4c0d-9bed-68fb5f827f9b req-58bb15da-096c-4eff-a65d-06d9df5c2be0 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:54.797792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-5b4ed62a-cdd2-4c0d-9bed-68fb5f827f9b req-58bb15da-096c-4eff-a65d-06d9df5c2be0 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:54.816230 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-5b4ed62a-cdd2-4c0d-9bed-68fb5f827f9b req-58bb15da-096c-4eff-a65d-06d9df5c2be0 service nova] Creating event network-changed:936e6a70-382e-4a7b-b0f3-253ad9d29445 for instance a1ecd861-42ce-4f1a-9367-4aee35de209f on hv-cinder-84067 May 12 14:52:54.825447 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-5b4ed62a-cdd2-4c0d-9bed-68fb5f827f9b req-58bb15da-096c-4eff-a65d-06d9df5c2be0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042711 May 12 14:52:54.826323 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 548/1102] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:55.082731 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:55.083333 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:55.090427 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:55.090993 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:55.091862 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:55.092276 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:55.298176 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:55.305978 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-70ccfaaf-7ea2-41eb-b9f5-fd28e975042e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.227175 May 12 14:52:55.306584 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 555/1103] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:55 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:56.328752 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:56.329459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:56.336400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:56.336879 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:56.337657 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:56.338096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:56.473192 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:56.481256 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-487f30d3-234d-41bf-902e-0fa46defa68d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.159672 May 12 14:52:56.481836 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 549/1104] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:56 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:57.348539 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:52:57.349395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 14:52:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:52:57.499347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:57.500000 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:57.507133 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:57.507588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:57.508405 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:57.508815 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:57.727817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:57.736562 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9b746d28-19b3-4d01-95ec-03e853db09e9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.241814 May 12 14:52:57.737128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 556/1105] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:57 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:58.756408 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:58.757020 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:58.763634 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:58.764076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:58.765323 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:58.765763 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:58.905960 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:58.914042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9b764278-77ad-46f9-ab46-d9106022c517 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.161640 May 12 14:52:58.914598 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 550/1106] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:58 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:59.936178 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:59.937220 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:52:59.948340 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:59.949128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:52:59.950370 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:52:59.951088 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:00.081967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:00.093304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-114f92e7-b6d2-40be-8532-ac29555712db tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.163839 May 12 14:53:00.094167 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 557/1107] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:52:59 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:00.636535 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-455157d7-7255-4e0c-827f-bf159a50f14e req-ce1b23ac-4268-4e7b-96fa-9a55bb98a31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ecd861-42ce-4f1a-9367-4aee35de209f", "name": "network-vif-plugged", "status": "completed", "tag": "936e6a70-382e-4a7b-b0f3-253ad9d29445"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:00.644908 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-455157d7-7255-4e0c-827f-bf159a50f14e req-ce1b23ac-4268-4e7b-96fa-9a55bb98a31d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:00.645560 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-455157d7-7255-4e0c-827f-bf159a50f14e req-ce1b23ac-4268-4e7b-96fa-9a55bb98a31d service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:00.656219 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-455157d7-7255-4e0c-827f-bf159a50f14e req-ce1b23ac-4268-4e7b-96fa-9a55bb98a31d service nova] Creating event network-vif-plugged:936e6a70-382e-4a7b-b0f3-253ad9d29445 for instance a1ecd861-42ce-4f1a-9367-4aee35de209f on hv-cinder-84067 May 12 14:53:00.661229 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-455157d7-7255-4e0c-827f-bf159a50f14e req-ce1b23ac-4268-4e7b-96fa-9a55bb98a31d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093915 May 12 14:53:00.661870 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 551/1108] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:01.112112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:01.112779 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:01.120847 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:01.121367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:01.122257 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:01.122757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:01.271148 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:01.278574 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5f45a5a8-b2b5-4944-b692-d943a48cd877 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.171124 May 12 14:53:01.279147 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 558/1109] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:53:01 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:02.299796 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:02.300490 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:02.306933 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:02.307386 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:02.308182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:02.308621 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:02.448264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:02.457215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ac8e738c-2a9f-4905-be54-a9dffd0a2749 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1358 microversion: 2.1 time: 0.162824 May 12 14:53:02.457784 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 552/1110] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:53:02 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:03.480763 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:03.481843 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:03.492828 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:03.493577 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:03.494838 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:03.495561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:03.640254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:03.648836 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d91e8ad4-44f1-47ee-a839-8ca153fe55f9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1548 microversion: 2.1 time: 0.174714 May 12 14:53:03.649429 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 559/1111] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:53:03 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:03.672909 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:03.673632 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:03.680577 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:03.681046 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:03.681812 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:03.682242 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:03.818691 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:03.827281 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0878ad3f-23fa-44df-bbb5-25d784696da2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1548 microversion: 2.1 time: 0.161319 May 12 14:53:03.827899 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 553/1112] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:53:03 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:03.843754 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:03.847609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:03.848309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Searching by: {'deleted': False, 'project_id': '7557d7be043140c29f88052c05ba38be'} {{(pid=123725) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 14:53:03.855466 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:03.855954 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:03.856738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:03.857177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:03.959824 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.multi_cell_list [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123725) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 14:53:04.059873 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8fc94308-1e0a-4b86-bffd-554c59c4348e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219839 May 12 14:53:04.060373 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 560/1113] 10.222.0.79 () {58 vars in 1124 bytes} [Thu May 12 14:53:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:04.073510 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:04.074111 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:04.080975 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:04.081425 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:04.082194 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:04.082625 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:04.222643 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:04.230947 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-0c1da2e5-d3cc-4ed7-b76e-dd3bfc335630 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1548 microversion: 2.1 time: 0.161468 May 12 14:53:04.231530 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 554/1114] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:53:04 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:05.800843 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b35dbba3-53af-48ff-bbdc-5919b14ab8ac tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "664b395c-e67b-425b-85f0-d16928d5e245"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:05.801902 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b35dbba3-53af-48ff-bbdc-5919b14ab8ac tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:05.808396 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b35dbba3-53af-48ff-bbdc-5919b14ab8ac tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:05.808844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b35dbba3-53af-48ff-bbdc-5919b14ab8ac tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:05.809602 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b35dbba3-53af-48ff-bbdc-5919b14ab8ac tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:05.810029 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b35dbba3-53af-48ff-bbdc-5919b14ab8ac tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:06.099478 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b35dbba3-53af-48ff-bbdc-5919b14ab8ac tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304043 May 12 14:53:06.100154 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 561/1115] 10.222.0.79 () {60 vars in 1322 bytes} [Thu May 12 14:53:05 2022] POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:13.710856 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:13.711464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:13.717930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:13.718424 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:13.719168 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:13.719597 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:13.856275 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:13.864548 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-402bc448-e55f-4080-8c95-135a26b9deaf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1594 microversion: 2.1 time: 0.157710 May 12 14:53:13.865119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 555/1116] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:53:13 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:15.670953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-35c3c83b-972c-4b9d-9a52-bfb39e3f419c req-668cd699-3f98-490b-a4e6-2f5ece1170ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ecd861-42ce-4f1a-9367-4aee35de209f", "tag": "936e6a70-382e-4a7b-b0f3-253ad9d29445"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:15.679254 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-35c3c83b-972c-4b9d-9a52-bfb39e3f419c req-668cd699-3f98-490b-a4e6-2f5ece1170ed service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:15.679968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-35c3c83b-972c-4b9d-9a52-bfb39e3f419c req-668cd699-3f98-490b-a4e6-2f5ece1170ed service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:15.691848 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-35c3c83b-972c-4b9d-9a52-bfb39e3f419c req-668cd699-3f98-490b-a4e6-2f5ece1170ed service nova] Creating event network-changed:936e6a70-382e-4a7b-b0f3-253ad9d29445 for instance a1ecd861-42ce-4f1a-9367-4aee35de209f on hv-cinder-84067 May 12 14:53:15.698567 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-35c3c83b-972c-4b9d-9a52-bfb39e3f419c req-668cd699-3f98-490b-a4e6-2f5ece1170ed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 May 12 14:53:15.699372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 562/1117] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:16.759923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1654396525"}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:16.760533 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:16.769955 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:16.770406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:16.771175 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:16.771641 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:16.902970 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.network.security_group_api [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Adding security group be08d949-ae09-493c-8c07-f0a579528073 to port 936e6a70-382e-4a7b-b0f3-253ad9d29445 May 12 14:53:17.303549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1c967e77-06be-47c9-89de-c613a150f915 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/action" status: 202 len: 0 microversion: 2.1 time: 0.548588 May 12 14:53:17.304302 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 556/1118] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:53:16 2022] POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:53:17.313367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:17.315016 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:53:17.323209 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:17.323667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:17.325955 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:17.326642 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:17.480845 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:17.489331 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-42ba3452-bed9-4a86-905e-596dd9c88fe9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1760 microversion: 2.1 time: 0.180199 May 12 14:53:17.490092 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 563/1119] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:53:17 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:17.713207 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-d4a23579-569d-4908-b839-079a5a3a15a4 req-fec686a9-a0a6-4dd6-a01d-0562a9edeaca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ecd861-42ce-4f1a-9367-4aee35de209f", "tag": "936e6a70-382e-4a7b-b0f3-253ad9d29445"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:17.722257 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d4a23579-569d-4908-b839-079a5a3a15a4 req-fec686a9-a0a6-4dd6-a01d-0562a9edeaca service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:53:17.722637 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-d4a23579-569d-4908-b839-079a5a3a15a4 req-fec686a9-a0a6-4dd6-a01d-0562a9edeaca service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:53:17.733932 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-d4a23579-569d-4908-b839-079a5a3a15a4 req-fec686a9-a0a6-4dd6-a01d-0562a9edeaca service nova] Creating event network-changed:936e6a70-382e-4a7b-b0f3-253ad9d29445 for instance a1ecd861-42ce-4f1a-9367-4aee35de209f on hv-cinder-84067 May 12 14:53:17.739497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-d4a23579-569d-4908-b839-079a5a3a15a4 req-fec686a9-a0a6-4dd6-a01d-0562a9edeaca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030149 May 12 14:53:17.740412 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 557/1120] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:18.026606 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-df47fbe5-aec3-4676-856e-dd1b59a8b355 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:18.028184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-df47fbe5-aec3-4676-856e-dd1b59a8b355 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:18.038876 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df47fbe5-aec3-4676-856e-dd1b59a8b355 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:18.039198 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df47fbe5-aec3-4676-856e-dd1b59a8b355 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:18.039998 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df47fbe5-aec3-4676-856e-dd1b59a8b355 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:18.040433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-df47fbe5-aec3-4676-856e-dd1b59a8b355 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:18.114743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-df47fbe5-aec3-4676-856e-dd1b59a8b355 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/action" status: 202 len: 0 microversion: 2.1 time: 0.096298 May 12 14:54:18.115371 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 564/1121] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:54:18 2022] POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:54:18.125607 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:18.126337 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:18.133096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:18.133640 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:18.134421 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:18.134839 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:18.343930 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:18.352374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-7acddf91-065e-402d-8777-97b388be1353 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1752 microversion: 2.1 time: 0.232417 May 12 14:54:18.352964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 558/1122] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:18 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:19.376241 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:19.377390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:19.386111 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:19.386555 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:19.387324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:19.387790 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:19.541182 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:19.550098 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9acab5fb-dac7-422a-90f1-17a0fa494fe7 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.182009 May 12 14:54:19.550682 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 565/1123] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:19 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:20.572601 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:20.573629 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:20.584451 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:20.585200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:20.586597 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:20.587227 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:20.750151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:20.758664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-00e8d716-d752-4fe8-95a5-a7950db56ced tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.193044 May 12 14:54:20.759242 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 559/1124] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:20 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:21.785692 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:21.786683 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:21.796389 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:21.796836 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:21.797609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:21.798036 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:21.952267 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:21.960401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-05477524-36a3-4fb2-ba07-9baa07f9e777 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.181249 May 12 14:54:21.960988 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 566/1125] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:21 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:22.980677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:22.981335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:22.988157 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:22.988604 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:22.989406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:22.989834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:23.131925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:23.140750 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b03651bb-7954-49d3-a988-adfe55ceee95 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.165710 May 12 14:54:23.141331 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 560/1126] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:22 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:24.162660 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:24.163608 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:24.174964 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:24.175748 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:24.177021 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:24.177744 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:24.344947 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:24.354781 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-1b0bd646-25da-4fb6-bb9d-4684ee83d426 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.198707 May 12 14:54:24.355834 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 567/1127] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:24 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:25.377292 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:25.378286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:25.389893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:25.390369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:25.391174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:25.391607 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:25.550366 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:25.558776 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1641f4e8-8b9a-4967-aff9-cec138b72c1e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.188029 May 12 14:54:25.559359 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 561/1128] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:25 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:26.580023 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:26.580637 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:26.587494 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:26.587933 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:26.588701 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:26.589138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:26.744932 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:26.756769 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-c8293df6-a1b1-427b-a142-c04b0c7d17a2 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.182613 May 12 14:54:26.757551 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 568/1129] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:26 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:27.779082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:27.780083 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:27.788406 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:27.788855 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:27.789633 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:27.790067 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:27.950763 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:27.959167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-e23a5c71-96d1-4c9d-bc67-0642581edc46 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.186722 May 12 14:54:27.959772 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 562/1130] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:27 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:28.981134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:28.982003 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:28.990726 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:28.991181 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:28.992334 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:28.992772 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:29.136039 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:29.144539 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-d1735016-043d-461f-b5d7-d313a4317d6d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1757 microversion: 2.1 time: 0.170105 May 12 14:54:29.145091 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 569/1131] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:28 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:30.166663 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:30.168011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:54:30.178770 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:30.179503 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:30.180831 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:54:30.181537 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:54:30.331783 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:30.342915 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-382e07a8-7c81-49b5-9033-4d4b564e127b tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1760 microversion: 2.1 time: 0.182676 May 12 14:54:30.343885 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 563/1132] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:54:30 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:31.517125 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:54:31.518122 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 14:54:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:55:25.889324 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1654396525"}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:25.890000 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:25.896401 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:25.896846 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:25.897609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:25.898034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:26.027006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.network.security_group_api [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Removing security group be08d949-ae09-493c-8c07-f0a579528073 from port 936e6a70-382e-4a7b-b0f3-253ad9d29445 May 12 14:55:26.437815 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-8d128d3e-4683-42d6-b389-3d8a9039d33f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/action" status: 202 len: 0 microversion: 2.1 time: 0.552313 May 12 14:55:26.438719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 570/1133] 10.222.0.79 () {60 vars in 1277 bytes} [Thu May 12 14:55:25 2022] POST /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:55:26.518075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-514946cb-bc92-472d-805d-c001b637689e req-ea0404dd-feae-488e-bfcf-e14c8fb9497b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ecd861-42ce-4f1a-9367-4aee35de209f", "tag": "936e6a70-382e-4a7b-b0f3-253ad9d29445"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:26.528082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-514946cb-bc92-472d-805d-c001b637689e req-ea0404dd-feae-488e-bfcf-e14c8fb9497b service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:26.529129 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-514946cb-bc92-472d-805d-c001b637689e req-ea0404dd-feae-488e-bfcf-e14c8fb9497b service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:26.554500 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-514946cb-bc92-472d-805d-c001b637689e req-ea0404dd-feae-488e-bfcf-e14c8fb9497b service nova] Creating event network-changed:936e6a70-382e-4a7b-b0f3-253ad9d29445 for instance a1ecd861-42ce-4f1a-9367-4aee35de209f on hv-cinder-84067 May 12 14:55:26.561180 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-514946cb-bc92-472d-805d-c001b637689e req-ea0404dd-feae-488e-bfcf-e14c8fb9497b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119415 May 12 14:55:26.562670 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 564/1134] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:27.652318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:27.656942 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:27.666485 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:27.667512 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:27.668738 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:27.669440 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:27.717477 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-fc782e1f-37c2-4590-a67d-e7e08129d9cd req-755ccdfc-cbb7-4423-bf3e-6615906c7524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ecd861-42ce-4f1a-9367-4aee35de209f", "tag": "936e6a70-382e-4a7b-b0f3-253ad9d29445"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:27.725893 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-fc782e1f-37c2-4590-a67d-e7e08129d9cd req-755ccdfc-cbb7-4423-bf3e-6615906c7524 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:27.726807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-fc782e1f-37c2-4590-a67d-e7e08129d9cd req-755ccdfc-cbb7-4423-bf3e-6615906c7524 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:27.740123 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-fc782e1f-37c2-4590-a67d-e7e08129d9cd req-755ccdfc-cbb7-4423-bf3e-6615906c7524 service nova] Creating event network-changed:936e6a70-382e-4a7b-b0f3-253ad9d29445 for instance a1ecd861-42ce-4f1a-9367-4aee35de209f on hv-cinder-84067 May 12 14:55:27.745646 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-fc782e1f-37c2-4590-a67d-e7e08129d9cd req-755ccdfc-cbb7-4423-bf3e-6615906c7524 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098689 May 12 14:55:27.747053 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 565/1135] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:27.765753 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.objects.instance [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lazy-loading 'services' on Instance uuid a1ecd861-42ce-4f1a-9367-4aee35de209f {{(pid=123725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:55:27.849653 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-164e41f6-f288-42f2-b68e-5d2231a01890 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments/664b395c-e67b-425b-85f0-d16928d5e245" status: 202 len: 0 microversion: 2.1 time: 0.205226 May 12 14:55:27.850406 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 571/1136] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:55:27 2022] DELETE /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments/664b395c-e67b-425b-85f0-d16928d5e245 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:55:27.859769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-06a27d99-9625-4fd8-83ec-3da3d76166bf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:27.860903 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-06a27d99-9625-4fd8-83ec-3da3d76166bf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:27.867790 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06a27d99-9625-4fd8-83ec-3da3d76166bf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:27.869293 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06a27d99-9625-4fd8-83ec-3da3d76166bf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:27.870575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06a27d99-9625-4fd8-83ec-3da3d76166bf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:27.871181 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-06a27d99-9625-4fd8-83ec-3da3d76166bf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:27.904154 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-06a27d99-9625-4fd8-83ec-3da3d76166bf tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048907 May 12 14:55:27.904774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 566/1137] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:55:27 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:28.918042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2fcbf50b-7fea-4684-b1d5-02df0af643fe tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:28.919053 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2fcbf50b-7fea-4684-b1d5-02df0af643fe tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:28.926165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2fcbf50b-7fea-4684-b1d5-02df0af643fe tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:28.926609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2fcbf50b-7fea-4684-b1d5-02df0af643fe tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:28.927528 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2fcbf50b-7fea-4684-b1d5-02df0af643fe tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:28.927989 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2fcbf50b-7fea-4684-b1d5-02df0af643fe tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:28.961390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2fcbf50b-7fea-4684-b1d5-02df0af643fe tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048728 May 12 14:55:28.962077 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 572/1138] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:55:28 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:29.978042 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ee5bcaec-155e-440d-9a00-c0805ac2497d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:29.979104 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ee5bcaec-155e-440d-9a00-c0805ac2497d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:29.986218 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee5bcaec-155e-440d-9a00-c0805ac2497d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:29.986659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee5bcaec-155e-440d-9a00-c0805ac2497d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:29.987424 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee5bcaec-155e-440d-9a00-c0805ac2497d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:29.987896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ee5bcaec-155e-440d-9a00-c0805ac2497d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:30.017566 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ee5bcaec-155e-440d-9a00-c0805ac2497d tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046325 May 12 14:55:30.018115 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 567/1139] 10.222.0.79 () {58 vars in 1301 bytes} [Thu May 12 14:55:29 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:55:30.028372 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:30.028911 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:30.035532 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:30.036015 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:30.036782 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:30.037213 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:30.115467 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] HTTP exception thrown: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f is not attached to volume 664b395c-e67b-425b-85f0-d16928d5e245 May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Request method failure captured: May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: DELETE /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments/664b395c-e67b-425b-85f0-d16928d5e245 HTTP/1.1 May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifR8irACS4oAdIenYo4ofk3VSkWZyuJ0uxFf_XzT0oJ6WYp0n7zsy01JQ5nmE6YxTTG5ZL8kMZt_0uXOqcK8ddv-NPrj3mM9zxA9lbtRBM0LCLTFJeTN0mzHPH8dGGKjyW6LhTyfw2ZkBDmxcUofDNQ5vTxMsESJDqFhTSM4TcsbaCoY May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 7557d7be043140c29f88052c05ba38be May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-TestMinimumBasicScenario-981802187 May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:55:30.117817 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7557d7be043140c29f88052c05ba38be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7557d7be043140c29f88052c05ba38be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7557d7be043140c29f88052c05ba38be", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7557d7be043140c29f88052c05ba38be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-TestMinimumBasicScenario-981802187 May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 7557d7be043140c29f88052c05ba38be May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-TestMinimumBasicScenario-981802187 May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-TestMinimumBasicScenario-981802187-project May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: cbe380821fbb421483675afa367066c5 May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-TestMinimumBasicScenario-981802187-project May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:55:30.119540 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f is not attached to volume 664b395c-e67b-425b-85f0-d16928d5e245 May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'server_id': 'a1ecd861-42ce-4f1a-9367-4aee35de209f', 'id': '664b395c-e67b-425b-85f0-d16928d5e245'} May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 664b395c-e67b-425b-85f0-d16928d5e245. May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:55:30.120487 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f is not attached to volume 664b395c-e67b-425b-85f0-d16928d5e245 May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f is not attached to volume 664b395c-e67b-425b-85f0-d16928d5e245 May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:55:30.121922 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Returning 404 to user: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f is not attached to volume 664b395c-e67b-425b-85f0-d16928d5e245 {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:55:30.122908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4770a864-bb42-488f-a7ec-ff436900e0b9 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments/664b395c-e67b-425b-85f0-d16928d5e245" status: 404 len: 154 microversion: 2.1 time: 0.095197 May 12 14:55:30.122908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 573/1140] 10.222.0.79 () {58 vars in 1415 bytes} [Thu May 12 14:55:30 2022] DELETE /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f/os-volume_attachments/664b395c-e67b-425b-85f0-d16928d5e245 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:31.270562 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:31.271087 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:31.277666 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:31.278119 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:31.278896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:31.279332 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:31.304043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:55:31.393706 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-bf5e13eb-d96c-4a42-81ab-7be5b0ac20a6 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 204 len: 0 microversion: 2.1 time: 0.126977 May 12 14:55:31.395082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 568/1141] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:55:31 2022] DELETE /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:55:31.403361 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:31.404120 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:31.410643 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:31.411122 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:31.411948 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:31.412378 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:31.549454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:31.557081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ec3d14dd-9b7c-47fd-af79-0723664dfb3f tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1554 microversion: 2.1 time: 0.157611 May 12 14:55:31.558013 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 574/1142] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:55:31 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:32.580232 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:32.581429 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:32.590923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:32.591368 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:32.592173 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:32.592601 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:32.729328 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:32.740971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-77ef8a45-1f5e-4468-8bd9-9465d4f2f09e tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1554 microversion: 2.1 time: 0.167797 May 12 14:55:32.741848 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 569/1143] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:55:32 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:33.762209 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:33.762984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:33.769657 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:33.770102 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:33.770871 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:33.771300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:33.957382 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-941502f1-1ca0-4613-b695-81b7bc71624d req-bc9a0a19-bf32-4aaf-ba97-d9c89b7bdb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ecd861-42ce-4f1a-9367-4aee35de209f", "name": "network-vif-deleted", "tag": "936e6a70-382e-4a7b-b0f3-253ad9d29445"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:33.966911 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-941502f1-1ca0-4613-b695-81b7bc71624d req-bc9a0a19-bf32-4aaf-ba97-d9c89b7bdb65 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:33.967362 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-941502f1-1ca0-4613-b695-81b7bc71624d req-bc9a0a19-bf32-4aaf-ba97-d9c89b7bdb65 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:33.979317 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-941502f1-1ca0-4613-b695-81b7bc71624d req-bc9a0a19-bf32-4aaf-ba97-d9c89b7bdb65 service nova] Creating event network-vif-deleted:936e6a70-382e-4a7b-b0f3-253ad9d29445 for instance a1ecd861-42ce-4f1a-9367-4aee35de209f on hv-cinder-84067 May 12 14:55:33.984583 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-941502f1-1ca0-4613-b695-81b7bc71624d req-bc9a0a19-bf32-4aaf-ba97-d9c89b7bdb65 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031186 May 12 14:55:33.985561 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 570/1144] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:55:33.988773 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe380821fbb421483675afa367066c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7557d7be043140c29f88052c05ba38be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:33.996844 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cb2bd973-d3cb-4c3f-b613-fe91a82eeed5 tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 200 len: 1554 microversion: 2.1 time: 0.241082 May 12 14:55:33.997412 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 575/1145] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:55:33 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:35.015718 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:35.016470 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] [instance: a1ecd861-42ce-4f1a-9367-4aee35de209f] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:55:35.023337 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:35.023813 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:35.024579 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:55:35.025011 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:55:35.040076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] HTTP exception thrown: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f could not be found. May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Request method failure captured: May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f HTTP/1.1 May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifR8irACS4oAdIenYo4ofk3VSkWZyuJ0uxFf_XzT0oJ6WYp0n7zsy01JQ5nmE6YxTTG5ZL8kMZt_0uXOqcK8ddv-NPrj3mM9zxA9lbtRBM0LCLTFJeTN0mzHPH8dGGKjyW6LhTyfw2ZkBDmxcUofDNQ5vTxMsESJDqFhTSM4TcsbaCoY May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 7557d7be043140c29f88052c05ba38be May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-TestMinimumBasicScenario-981802187 May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 14:55:35.042016 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7557d7be043140c29f88052c05ba38be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7557d7be043140c29f88052c05ba38be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7557d7be043140c29f88052c05ba38be", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7557d7be043140c29f88052c05ba38be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-TestMinimumBasicScenario-981802187 May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 7557d7be043140c29f88052c05ba38be May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-TestMinimumBasicScenario-981802187 May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-TestMinimumBasicScenario-981802187-project May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: cbe380821fbb421483675afa367066c5 May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-TestMinimumBasicScenario-981802187-project May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f could not be found. May 12 14:55:35.043803 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'a1ecd861-42ce-4f1a-9367-4aee35de209f'} May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f could not be found. May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:55:35.044972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f could not be found. May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f could not be found. May 12 14:55:35.046415 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 14:55:35.048029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Returning 404 to user: Instance a1ecd861-42ce-4f1a-9367-4aee35de209f could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:55:35.048029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-39c7691c-5c4f-46db-af89-951b94a08ace tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f" status: 404 len: 111 microversion: 2.1 time: 0.032680 May 12 14:55:35.048029 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 571/1146] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:55:35 2022] GET /compute/v2.1/servers/a1ecd861-42ce-4f1a-9367-4aee35de209f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:35.055585 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-13a8c256-1ba4-42ff-974b-bef12630e8cd tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] Calling method '.version_select at 0x7f4650a34160>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:35.081346 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-13a8c256-1ba4-42ff-974b-bef12630e8cd tempest-TestMinimumBasicScenario-981802187 tempest-TestMinimumBasicScenario-981802187-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-886522403" status: 202 len: 0 microversion: 2.1 time: 0.032077 May 12 14:55:35.082034 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 576/1147] 10.222.0.79 () {58 vars in 1268 bytes} [Thu May 12 14:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-886522403 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:55:53.512421 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-9fb539ef-35d6-4e7b-b3f5-1bba63ecc8bc tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Action: 'create', calling method: .version_select at 0x7f4650cb3d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1753658592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Xyo6npTa9cNT+8Db/zyD6n6lkIJpNdxsoGdLntUMHiX/8g6jKRx7PenvRL4zquM3gIS6me9eExTK+eCoI3I6C2r2+x+PXGe2AiKxv3Kyr7D9282dnQTp62nO5SGFwpQ=="}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:53.526235 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-9fb539ef-35d6-4e7b-b3f5-1bba63ecc8bc tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for project 2f03df9aaaa743058d78385df499c624. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:55:53.530068 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-9fb539ef-35d6-4e7b-b3f5-1bba63ecc8bc tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for user dcf927fe5196454e96ab65e6cda3e1b8 and project 2f03df9aaaa743058d78385df499c624. Resources: {'key_pairs'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:55:53.558682 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-9fb539ef-35d6-4e7b-b3f5-1bba63ecc8bc tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.224105 May 12 14:55:53.559738 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 572/1148] 10.222.0.79 () {60 vars in 1158 bytes} [Thu May 12 14:55:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:53.753497 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:55:53.753835 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 14:55:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:56:16.302564 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-536521815", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1753658592", "security_groups": [{"name": "tempest-secgroup-smoke-2142004759"}], "block_device_mapping_v2": [{"uuid": "2a477484-62b1-428a-b636-c41fa02c3fc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46ed73d6-9354-4e2f-9d43-1673630ad078"}]}} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:16.422582 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.network.neutron [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] validate_networks() for [('46ed73d6-9354-4e2f-9d43-1673630ad078', None, None, None, None, None)] {{(pid=123725) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:56:16.914912 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Flavor limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:56:16.915347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Image limits 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:56:16.915859 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Flavor pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:56:16.916273 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Image pref 0:0:0 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:56:16.917033 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.virt.hardware [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:56:16.927475 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:16.927894 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:16.928701 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:16.929138 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:16.947104 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for project 2f03df9aaaa743058d78385df499c624. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:56:16.952457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.quota [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for user dcf927fe5196454e96ab65e6cda3e1b8 and project 2f03df9aaaa743058d78385df499c624. Resources: {'instances', 'cores', 'ram'} {{(pid=123725) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:56:17.011681 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Going to run 1 instances... {{(pid=123725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:56:17.013829 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a477484-62b1-428a-b636-c41fa02c3fc2',volume_size=None,volume_type=None)] {{(pid=123725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:56:17.153799 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [d815e410-7eb8-4406-86ce-50c5b8e9f720] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:56:18.166127 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [d815e410-7eb8-4406-86ce-50c5b8e9f720] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35912. May 12 14:56:18.172094 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-bd15b15d-8fca-4be7-9135-b2945ed42078 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.873600 May 12 14:56:18.173087 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 577/1149] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:56:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:56:18.195330 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-59eeff2f-caeb-4ab4-93c8-6a5dbef96349 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:18.196010 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-59eeff2f-caeb-4ab4-93c8-6a5dbef96349 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:18.254804 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-59eeff2f-caeb-4ab4-93c8-6a5dbef96349 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:18.261939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-59eeff2f-caeb-4ab4-93c8-6a5dbef96349 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1094 microversion: 2.1 time: 0.082450 May 12 14:56:18.262769 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 573/1150] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:18 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:19.279311 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:19.279948 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:19.286632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:19.287230 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:19.288074 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:19.288508 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:19.639405 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:19.648128 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0c17ecd8-15ca-4538-bfc9-bd2f0b51b48b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1210 microversion: 2.1 time: 0.373299 May 12 14:56:19.648655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 578/1151] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:19 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1210 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:20.665912 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:20.667547 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:20.674480 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:20.674919 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:20.675677 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:20.676167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:20.895905 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:20.904973 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-39fb7999-5efd-421b-9ec7-bd0dc0f5693a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.242813 May 12 14:56:20.905570 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 574/1152] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:20 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:56:21.081987 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-4538bae1-4e6d-47a6-9616-8e5ede20e184 req-a8d07cf2-ad77-4721-a9d4-23be1afa39f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8da009-6bac-41a0-beae-ef20901cec9e", "tag": "05eeae1d-ffbd-4986-84fb-1df4db0fe001"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:21.092526 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-4538bae1-4e6d-47a6-9616-8e5ede20e184 req-a8d07cf2-ad77-4721-a9d4-23be1afa39f8 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:21.092965 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-4538bae1-4e6d-47a6-9616-8e5ede20e184 req-a8d07cf2-ad77-4721-a9d4-23be1afa39f8 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:21.104726 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-4538bae1-4e6d-47a6-9616-8e5ede20e184 req-a8d07cf2-ad77-4721-a9d4-23be1afa39f8 service nova] Creating event network-changed:05eeae1d-ffbd-4986-84fb-1df4db0fe001 for instance da8da009-6bac-41a0-beae-ef20901cec9e on hv-cinder-84067 May 12 14:56:21.110432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-4538bae1-4e6d-47a6-9616-8e5ede20e184 req-a8d07cf2-ad77-4721-a9d4-23be1afa39f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032070 May 12 14:56:21.111258 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 579/1153] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:56:21.927177 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:21.928405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:21.940075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:21.941001 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:21.942297 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:21.943027 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:22.084065 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:22.092076 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4bcdbd70-d970-43ce-88b1-6ce65d79cf1c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.171521 May 12 14:56:22.092649 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 575/1154] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:21 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:23.114783 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:23.115984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:23.124936 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:23.125389 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:23.126163 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:23.126597 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:23.268661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:23.276641 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-56502ca1-127e-4a8d-8707-8dc36a7530ff tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.170275 May 12 14:56:23.277228 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 580/1155] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:23 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:24.294988 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:24.295620 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:24.302748 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:24.303193 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:24.304082 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:24.304522 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:24.448995 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:24.457341 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-1d97e2a0-72a1-405d-b380-7d092db40144 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.166827 May 12 14:56:24.457895 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 576/1156] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:24 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:25.482262 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:25.483376 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:25.493967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:25.494741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:25.496509 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:25.497306 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:25.657655 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:25.665134 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f86c2ee1-3233-443a-bca3-eec586ea206d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.190331 May 12 14:56:25.665711 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 581/1157] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:25 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:26.686707 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:26.687751 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:26.698623 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:26.699429 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:26.700383 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:26.700815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:26.847540 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:26.855245 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4d1cd8d3-ebd2-43eb-a02a-17d0577db881 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.175086 May 12 14:56:26.856017 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 577/1158] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:26 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:27.873042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:27.873662 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:27.880596 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:27.881072 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:27.881813 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:27.882248 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:28.027950 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:28.037985 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6e2b4c15-ad3a-4962-9c23-0f30d8024ee1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.169183 May 12 14:56:28.038580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 582/1159] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:27 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:29.058141 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:29.058891 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:29.068621 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:29.069273 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:29.070374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:29.071037 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:29.222462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:29.230504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-86bbc6aa-0a10-4ada-8c30-e5167e13166d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.178009 May 12 14:56:29.231075 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 578/1160] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:29 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:30.248659 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:30.249242 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:30.257006 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:30.257458 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:30.258268 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:30.258702 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:30.407861 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:30.420256 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a325e6fd-9d72-4d60-975f-f46d85d456c4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.175221 May 12 14:56:30.421015 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 583/1161] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:30 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:31.439743 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:31.440759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:31.451167 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:31.451805 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:31.453018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:31.453697 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:31.527083 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-c49f7bd2-14c1-4052-9833-12dffcdf6d7f req-886848b4-69dc-43bb-89b6-cca4acd85e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8da009-6bac-41a0-beae-ef20901cec9e", "name": "network-vif-plugged", "status": "completed", "tag": "05eeae1d-ffbd-4986-84fb-1df4db0fe001"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:31.536283 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c49f7bd2-14c1-4052-9833-12dffcdf6d7f req-886848b4-69dc-43bb-89b6-cca4acd85e63 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:31.536728 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-c49f7bd2-14c1-4052-9833-12dffcdf6d7f req-886848b4-69dc-43bb-89b6-cca4acd85e63 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:31.552154 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-c49f7bd2-14c1-4052-9833-12dffcdf6d7f req-886848b4-69dc-43bb-89b6-cca4acd85e63 service nova] Creating event network-vif-plugged:05eeae1d-ffbd-4986-84fb-1df4db0fe001 for instance da8da009-6bac-41a0-beae-ef20901cec9e on hv-cinder-84067 May 12 14:56:31.557171 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-c49f7bd2-14c1-4052-9833-12dffcdf6d7f req-886848b4-69dc-43bb-89b6-cca4acd85e63 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033985 May 12 14:56:31.557845 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 584/1162] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:56:31.605209 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:31.614390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-58c5ffbe-bd10-4e56-9836-bfb7d0eb8c20 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.181097 May 12 14:56:31.615232 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 579/1163] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:31 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:32.636685 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:32.637766 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:32.646802 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:32.647260 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:32.648038 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:32.648463 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:32.796092 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:32.805384 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-7251fec9-a830-4552-911a-e728df29b4b1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1266 microversion: 2.1 time: 0.176397 May 12 14:56:32.806337 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 585/1164] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:32 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:33.824504 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:33.825096 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:33.832002 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:33.832445 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:33.833217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:33.833665 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:33.964506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:33.972400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2008efb3-f3bb-4fce-8e03-06b08240d2ba tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1452 microversion: 2.1 time: 0.151398 May 12 14:56:33.972679 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 580/1165] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:33 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:33.997438 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:33.998112 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:56:34.006756 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:34.007194 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:34.007991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:34.008414 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:34.155719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:34.167282 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-261429d9-eaac-4d9c-abda-4b5a7bbd249a tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1452 microversion: 2.1 time: 0.176136 May 12 14:56:34.168098 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 586/1166] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:56:33 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:35.953690 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-c82dc675-4391-42ff-b026-826b21b718ec req-ff900a2d-d697-4b48-a325-867a4788b938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8da009-6bac-41a0-beae-ef20901cec9e", "tag": "05eeae1d-ffbd-4986-84fb-1df4db0fe001"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:35.962760 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-c82dc675-4391-42ff-b026-826b21b718ec req-ff900a2d-d697-4b48-a325-867a4788b938 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:56:35.963200 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-c82dc675-4391-42ff-b026-826b21b718ec req-ff900a2d-d697-4b48-a325-867a4788b938 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:56:35.974879 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-c82dc675-4391-42ff-b026-826b21b718ec req-ff900a2d-d697-4b48-a325-867a4788b938 service nova] Creating event network-changed:05eeae1d-ffbd-4986-84fb-1df4db0fe001 for instance da8da009-6bac-41a0-beae-ef20901cec9e on hv-cinder-84067 May 12 14:56:35.980165 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-c82dc675-4391-42ff-b026-826b21b718ec req-ff900a2d-d697-4b48-a325-867a4788b938 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030119 May 12 14:56:35.980828 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 581/1167] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:58:50.110638 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 12 14:58:50.116944 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:50.117757 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:50.125086 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:50.125537 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:50.126300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:50.126730 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:50.151486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Going to try to terminate instance {{(pid=123725) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:58:50.241502 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-9ad9cfda-377b-49ea-8118-0b51f652e155 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "DELETE /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 204 len: 0 microversion: 2.1 time: 0.134236 May 12 14:58:50.242105 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 587/1168] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 14:58:50 2022] DELETE /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:58:50.249759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb9f0ee6-ba6e-4c56-93c9-40370716aeaa] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:58:50.253882 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:50.254589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:50.261377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:50.261823 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:50.262591 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:50.263026 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:50.473099 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:50.481036 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-15a4dcd6-155e-498d-a442-955f10b95b4b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1577 microversion: 2.1 time: 0.233299 May 12 14:58:50.481672 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 582/1169] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:50 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:51.504084 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:51.505116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:51.514752 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:51.515196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:51.516004 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:51.516431 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:51.521668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36010. May 12 14:58:51.705177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:51.712760 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e1d803eb-55c8-402e-b137-2e78aa9456a6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1577 microversion: 2.1 time: 0.215985 May 12 14:58:51.713335 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 588/1170] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:51 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:58:52.734955 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:52.735531 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:52.749024 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb9f0ee6-ba6e-4c56-93c9-40370716aeaa] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36016. May 12 14:58:52.751428 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:52.751873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:52.752652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:52.753085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:52.843929 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:52.851286 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c464b92c-0074-470f-a10c-6e9499371a49 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1509 microversion: 2.1 time: 0.120299 May 12 14:58:52.851890 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 583/1171] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:52 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1509 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:53.087347 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-8c35f0c5-8e36-4d50-914f-21daf17f9e63 req-c4e69464-64fc-4fb7-b1fa-684cf448db1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8da009-6bac-41a0-beae-ef20901cec9e", "name": "network-vif-deleted", "tag": "05eeae1d-ffbd-4986-84fb-1df4db0fe001"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:53.096637 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-8c35f0c5-8e36-4d50-914f-21daf17f9e63 req-c4e69464-64fc-4fb7-b1fa-684cf448db1a service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:53.097493 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-8c35f0c5-8e36-4d50-914f-21daf17f9e63 req-c4e69464-64fc-4fb7-b1fa-684cf448db1a service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:53.109975 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-8c35f0c5-8e36-4d50-914f-21daf17f9e63 req-c4e69464-64fc-4fb7-b1fa-684cf448db1a service nova] Creating event network-vif-deleted:05eeae1d-ffbd-4986-84fb-1df4db0fe001 for instance da8da009-6bac-41a0-beae-ef20901cec9e on hv-cinder-84067 May 12 14:58:53.116298 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-8c35f0c5-8e36-4d50-914f-21daf17f9e63 req-c4e69464-64fc-4fb7-b1fa-684cf448db1a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036140 May 12 14:58:53.121864 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 589/1172] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:58:53.868039 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:53.868648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:53.877471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:53.878289 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:53.879317 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:53.880106 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:53.915552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:53.916483 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:53.917010 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.objects.instance [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lazy-loading 'fault' on Instance uuid da8da009-6bac-41a0-beae-ef20901cec9e {{(pid=123726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:58:53.959621 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:53.971400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-bb4c102f-780c-425e-995b-ce8666860bd7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 200 len: 1230 microversion: 2.1 time: 0.107096 May 12 14:58:53.981479 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 584/1173] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:53 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:54.990668 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:54.992231 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:54.999627 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:55.000432 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:55.001364 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:55.001916 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:55.015484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] HTTP exception thrown: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Request method failure captured: May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e HTTP/1.1 May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifR_09h-AOYBlvqlq4K3f8A5oE1mxK6E6aP2xpkxgFHOAeST6tLOrZWVJPQ97IGgSVWPKsBB_8W6e9bv399KrPGWpHfzTeZQwjcGoJSRxneT4YhOETJGG2eKEJnP2bChWsh2aTcI0X-W2ZvaTJcdKar7R7L4EZM2stHH-n57pkbI_-Xk May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 2f03df9aaaa743058d78385df499c624 May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-TestVolumeBootPattern-1510473149 May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 14:58:55.017116 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f03df9aaaa743058d78385df499c624", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f03df9aaaa743058d78385df499c624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-TestVolumeBootPattern-1510473149 May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 2f03df9aaaa743058d78385df499c624 May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-TestVolumeBootPattern-1510473149 May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-TestVolumeBootPattern-1510473149-project May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: dcf927fe5196454e96ab65e6cda3e1b8 May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-TestVolumeBootPattern-1510473149-project May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 14:58:55.019048 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'da8da009-6bac-41a0-beae-ef20901cec9e'} May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:58:55.020196 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 14:58:55.021907 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 14:58:55.025486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Returning 404 to user: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:58:55.025486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-fa41a1c6-3baf-48ed-b0e0-11e196c15113 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 404 len: 111 microversion: 2.1 time: 0.032829 May 12 14:58:55.025486 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 590/1174] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:54 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:58:55.067794 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-216246222", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1753658592", "security_groups": [{"name": "tempest-secgroup-smoke-2142004759"}], "block_device_mapping_v2": [{"uuid": "2a477484-62b1-428a-b636-c41fa02c3fc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46ed73d6-9354-4e2f-9d43-1673630ad078"}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:55.182418 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] validate_networks() for [('46ed73d6-9354-4e2f-9d43-1673630ad078', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:58:55.632525 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:58:55.633105 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:58:55.633819 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:58:55.634348 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:58:55.634952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:58:55.649655 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:55.650111 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:55.651182 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:55.651952 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:55.670110 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for project 2f03df9aaaa743058d78385df499c624. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:58:55.674623 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for user dcf927fe5196454e96ab65e6cda3e1b8 and project 2f03df9aaaa743058d78385df499c624. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:58:55.737134 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:58:55.739252 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a477484-62b1-428a-b636-c41fa02c3fc2',volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:58:55.878706 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [f55c55ff-fe79-415f-86f8-ffd1cc4a0c91] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:58:56.888506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [f55c55ff-fe79-415f-86f8-ffd1cc4a0c91] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36044. May 12 14:58:56.893369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ef57fdcf-75b3-45c5-abae-8f061fbbcf90 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.829485 May 12 14:58:56.894043 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 585/1175] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 14:58:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:58:56.904274 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-5451f71e-070e-4ce5-bd7d-80c7fdc23c7c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:56.904958 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-5451f71e-070e-4ce5-bd7d-80c7fdc23c7c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:56.963739 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-5451f71e-070e-4ce5-bd7d-80c7fdc23c7c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:56.974094 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-5451f71e-070e-4ce5-bd7d-80c7fdc23c7c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1094 microversion: 2.1 time: 0.073661 May 12 14:58:56.974964 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 591/1176] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:56 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:57.990473 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:57.991807 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:57.999072 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:57.999868 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:58.000898 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:58.001477 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:58.082270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:58.091652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-5fba2703-d89f-4d2c-9bb6-491a001c3750 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1210 microversion: 2.1 time: 0.104827 May 12 14:58:58.092259 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 586/1177] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:57 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:59.109526 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:59.110165 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:58:59.117224 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:59.117713 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:59.118547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:59.118977 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:59.334860 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:59.342748 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-909dd5c5-1afd-465d-8d17-da92d3e22710 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.237219 May 12 14:58:59.343495 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 592/1178] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:58:59 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:59.531506 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-b0bf67d2-742f-4067-b022-124488e16c22 req-ae3b4d74-7949-4fd7-9866-5306fcccaf88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67475bb-f5a8-4429-91ca-5e8ee942cb10", "tag": "bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:59.541984 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-b0bf67d2-742f-4067-b022-124488e16c22 req-ae3b4d74-7949-4fd7-9866-5306fcccaf88 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:58:59.542748 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-b0bf67d2-742f-4067-b022-124488e16c22 req-ae3b4d74-7949-4fd7-9866-5306fcccaf88 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:58:59.558047 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-b0bf67d2-742f-4067-b022-124488e16c22 req-ae3b4d74-7949-4fd7-9866-5306fcccaf88 service nova] Creating event network-changed:bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6 for instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 on hv-cinder-84067 May 12 14:58:59.563052 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR oslo.messaging._drivers.impl_rabbit [req-b0bf67d2-742f-4067-b022-124488e16c22 req-ae3b4d74-7949-4fd7-9866-5306fcccaf88 service nova] [5709faf1-8649-49aa-ad86-a29164d8f498] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:59:00.363906 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:00.365049 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:00.375425 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:00.375968 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:00.376743 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:00.377177 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:00.523246 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:00.535506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-00eaf0fe-7d97-4c5f-80a5-b04584434041 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.177531 May 12 14:59:00.536411 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 593/1179] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:00 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:00.570965 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [req-b0bf67d2-742f-4067-b022-124488e16c22 req-ae3b4d74-7949-4fd7-9866-5306fcccaf88 service nova] [5709faf1-8649-49aa-ad86-a29164d8f498] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36068. May 12 14:59:00.574863 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-b0bf67d2-742f-4067-b022-124488e16c22 req-ae3b4d74-7949-4fd7-9866-5306fcccaf88 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.047923 May 12 14:59:00.575613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 587/1180] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:59:01.560189 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:01.560893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:01.567851 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:01.568292 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:01.569046 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:01.569470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:01.712131 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:01.720484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-3657b1ba-7109-4fe3-8f6e-beb3a5974dae tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.167229 May 12 14:59:01.721081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 594/1181] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:01 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:02.739140 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:02.740127 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:02.746940 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:02.747398 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:02.748512 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:02.748948 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:02.884869 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:02.892876 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-cb9b873f-0017-4edb-8ca6-b412dcd9bead tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.158572 May 12 14:59:02.893424 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 588/1182] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:02 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:03.911609 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:03.912437 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:03.922144 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:03.922982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:03.924293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:03.925115 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:04.088057 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:04.096293 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-4359f055-03b9-4565-8d64-d66ee599fd3d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.190755 May 12 14:59:04.096897 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 595/1183] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:03 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:05.114176 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:05.114797 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:05.121825 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:05.122312 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:05.123085 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:05.123534 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:05.259622 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:05.267442 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-cbc57bf2-ca45-4eeb-a3c4-ea1451c110db tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.157290 May 12 14:59:05.268056 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 589/1184] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:05 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:06.285310 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:06.285967 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:06.293670 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:06.294150 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:06.294953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:06.295405 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:06.437889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:06.445342 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-b72ff283-8551-43d4-b34c-fa72df1be9f1 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.164483 May 12 14:59:06.445909 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 596/1185] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:06 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:07.466600 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:07.467517 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:07.476154 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:07.476567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:07.477353 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:07.477783 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:07.610347 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:07.618873 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6db1cac6-a83d-4465-9bcb-951b4beabc0c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.159079 May 12 14:59:07.619446 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 590/1186] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:07 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:08.640175 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:08.641178 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:08.648433 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:08.648876 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:08.649626 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:08.650047 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:08.779759 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:08.788718 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-0e5ab9e3-211a-4e7d-b4ca-fb5e924985f6 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.154972 May 12 14:59:08.789309 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 597/1187] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:08 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:09.810502 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:09.811377 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:09.819668 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:09.820136 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:09.820900 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:09.821336 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:10.232151 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:10.241285 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-d1bc8bab-c260-4f90-b36e-823e2fc5c8f4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.437131 May 12 14:59:10.241874 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 591/1188] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:09 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:10.270689 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-982a215a-24eb-4eb7-b876-d853930e2262 req-db8ca43f-3e5e-41bb-bb2c-712ac07e5d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67475bb-f5a8-4429-91ca-5e8ee942cb10", "name": "network-vif-plugged", "status": "completed", "tag": "bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:10.279232 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-982a215a-24eb-4eb7-b876-d853930e2262 req-db8ca43f-3e5e-41bb-bb2c-712ac07e5d29 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:10.279679 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-982a215a-24eb-4eb7-b876-d853930e2262 req-db8ca43f-3e5e-41bb-bb2c-712ac07e5d29 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:10.293386 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-982a215a-24eb-4eb7-b876-d853930e2262 req-db8ca43f-3e5e-41bb-bb2c-712ac07e5d29 service nova] Creating event network-vif-plugged:bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6 for instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 on hv-cinder-84067 May 12 14:59:10.298457 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-982a215a-24eb-4eb7-b876-d853930e2262 req-db8ca43f-3e5e-41bb-bb2c-712ac07e5d29 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115542 May 12 14:59:10.299050 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 598/1189] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:59:11.259585 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:11.260221 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:11.267020 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:11.267462 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:11.268258 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:11.268684 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:11.408272 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:11.419131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a38d35bc-e6df-4a5e-bfaa-c99b12492d77 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1266 microversion: 2.1 time: 0.163255 May 12 14:59:11.420012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 592/1190] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:11 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:12.445170 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:12.446205 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:12.455470 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:12.456174 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:12.457456 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:12.457908 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:12.617473 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:12.625505 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-a787a413-b5c1-4744-b235-37a29038b346 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1453 microversion: 2.1 time: 0.187879 May 12 14:59:12.627062 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 599/1191] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:12 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:12.644120 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:12.644961 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:59:12.651983 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:12.652426 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:12.653193 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:12.653620 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:12.818223 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:12.829954 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-b2674ad3-f9ae-4883-847b-198955141819 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1453 microversion: 2.1 time: 0.188424 May 12 14:59:12.830565 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 593/1192] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 14:59:12 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:14.645580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-529eeaec-9e31-4fa8-8a4e-e3e43ea726c6 req-85e48713-e79e-4ea4-98cd-12f67a0527c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67475bb-f5a8-4429-91ca-5e8ee942cb10", "tag": "bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:14.654542 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-529eeaec-9e31-4fa8-8a4e-e3e43ea726c6 req-85e48713-e79e-4ea4-98cd-12f67a0527c1 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:59:14.654983 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-529eeaec-9e31-4fa8-8a4e-e3e43ea726c6 req-85e48713-e79e-4ea4-98cd-12f67a0527c1 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:59:14.665892 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-529eeaec-9e31-4fa8-8a4e-e3e43ea726c6 req-85e48713-e79e-4ea4-98cd-12f67a0527c1 service nova] Creating event network-changed:bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6 for instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 on hv-cinder-84067 May 12 14:59:14.671317 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-529eeaec-9e31-4fa8-8a4e-e3e43ea726c6 req-85e48713-e79e-4ea4-98cd-12f67a0527c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029908 May 12 14:59:14.671950 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 600/1193] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 14:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:01:02.328681 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:01:02.329853 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 15:01:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:01:11.534321 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:01:11.535139 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 15:01:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:01:13.829346 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-984237168", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1753658592", "security_groups": [{"name": "tempest-secgroup-smoke-2142004759"}], "block_device_mapping_v2": [{"uuid": "8e5f92ce-e39a-4d1b-aa45-99d4aab674d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46ed73d6-9354-4e2f-9d43-1673630ad078"}]}} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:01:13.947205 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.network.neutron [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] validate_networks() for [('46ed73d6-9354-4e2f-9d43-1673630ad078', None, None, None, None, None)] {{(pid=123726) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:01:14.365470 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Flavor limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:01:14.365956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Image limits 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:01:14.366400 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Flavor pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:01:14.366903 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Image pref 0:0:0 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:01:14.367146 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.virt.hardware [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:01:14.378806 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:14.379747 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:14.381169 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:14.381925 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:14.400955 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for project 2f03df9aaaa743058d78385df499c624. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:01:14.405114 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.quota [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Getting quotas for user dcf927fe5196454e96ab65e6cda3e1b8 and project 2f03df9aaaa743058d78385df499c624. Resources: {'instances', 'cores', 'ram'} {{(pid=123726) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:01:14.477390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Going to run 1 instances... {{(pid=123726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:01:14.479552 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e5f92ce-e39a-4d1b-aa45-99d4aab674d2',volume_size=None,volume_type=None)] {{(pid=123726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:01:14.645913 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2defc418-0dbc-4964-bc26-4b1821b54854 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.821720 May 12 15:01:14.646580 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 594/1194] 10.222.0.79 () {60 vars in 1146 bytes} [Thu May 12 15:01:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:01:14.654952 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 12 15:01:14.660114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-114a8446-4522-4a53-8628-0c198855d45f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:14.661355 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-114a8446-4522-4a53-8628-0c198855d45f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:14.727149 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-114a8446-4522-4a53-8628-0c198855d45f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:14.734946 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-114a8446-4522-4a53-8628-0c198855d45f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1094 microversion: 2.1 time: 0.081812 May 12 15:01:14.735758 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 601/1195] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:14 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:15.756335 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:15.756956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:15.764945 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:15.765396 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:15.766390 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:15.768107 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:15.857211 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:15.866507 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-a153d60b-05eb-412a-9678-14cb46f5c9af tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1200 microversion: 2.1 time: 0.116852 May 12 15:01:15.867264 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 595/1196] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:15 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1200 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:16.887114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:16.887799 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:16.896142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:16.896588 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:16.897367 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:16.897821 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:16.901318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36208. May 12 15:01:17.106320 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:17.115537 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-cbb54414-c229-4477-a92d-633d0ce74bd8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.234844 May 12 15:01:17.116174 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 602/1197] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:16 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:17.416653 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-f0953b95-99ab-4f77-85ee-b46bc92be801 req-f7b98b1c-d395-4ff3-ae8f-ee50e02c5504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9266b7-e9b6-4a12-b3c5-150b3874e80c", "tag": "e549187a-8ace-4b54-9be7-6834bb57c0d8"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:01:17.425626 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-f0953b95-99ab-4f77-85ee-b46bc92be801 req-f7b98b1c-d395-4ff3-ae8f-ee50e02c5504 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:17.426198 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-f0953b95-99ab-4f77-85ee-b46bc92be801 req-f7b98b1c-d395-4ff3-ae8f-ee50e02c5504 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:17.439716 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-f0953b95-99ab-4f77-85ee-b46bc92be801 req-f7b98b1c-d395-4ff3-ae8f-ee50e02c5504 service nova] Creating event network-changed:e549187a-8ace-4b54-9be7-6834bb57c0d8 for instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c on hv-cinder-84067 May 12 15:01:17.445303 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-f0953b95-99ab-4f77-85ee-b46bc92be801 req-f7b98b1c-d395-4ff3-ae8f-ee50e02c5504 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115685 May 12 15:01:17.445979 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 596/1198] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 15:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:01:18.134484 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:18.135277 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:18.143936 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:18.144506 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:18.145454 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:18.145995 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:18.178636 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:01:18.178867 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 15:01:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c (ip 10.222.0.79) !!! May 12 15:01:18.285629 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:18.293531 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-912223b7-96d0-44a4-aaa1-c1b3d59234c7 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.163914 May 12 15:01:18.294101 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 603/1199] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:18 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:19.315923 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:19.316971 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:19.327549 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:19.328337 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:19.329588 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:19.330301 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:19.480095 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:19.492777 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6324727c-8f71-492a-9c98-f6575cffcf56 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.184581 May 12 15:01:19.493540 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 597/1200] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:19 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:20.517460 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:20.518418 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:20.525866 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:20.526320 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:20.527089 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:20.527522 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:20.676312 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:20.684172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-61cce1f8-f7b4-486d-833c-1fe5060f44d8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.173336 May 12 15:01:20.684761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 604/1201] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:20 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:21.705864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:21.706815 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:21.718404 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:21.719145 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:21.720927 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:21.721650 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:21.875128 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:21.883247 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-791e84f6-9aa9-46d1-aa95-9a28f33a19ca tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.183974 May 12 15:01:21.883881 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 598/1202] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:21 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:22.903789 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:22.904451 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:22.913661 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:22.914168 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:22.915042 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:22.915889 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:23.053547 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:23.061173 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6571cfe7-9cd7-4a69-9af1-e5b1b18a9732 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.163347 May 12 15:01:23.061753 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 605/1203] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:22 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:24.082531 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:24.083372 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:24.092764 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:24.093401 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:24.094521 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:24.095033 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:24.260452 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:24.270690 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-82be66b7-3a0b-4383-9640-2dc9ec9106e8 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.194532 May 12 15:01:24.271285 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 599/1204] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:24 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:25.288900 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:25.289489 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:25.297080 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:25.297569 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:25.298402 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:25.298873 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:25.434059 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:25.445399 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-e8ebd5df-6595-46f5-aff3-adc075e22d00 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.161000 May 12 15:01:25.445982 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 606/1205] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:25 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:26.464217 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:26.464896 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:26.472495 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:26.472998 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:26.473894 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:26.474413 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:26.628013 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:26.636621 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-ccd5a969-4145-412f-9d9b-234916c3079c tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.176779 May 12 15:01:26.637195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 600/1206] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:26 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:26.926517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-1aa3ac17-a296-4f48-90f5-7a418c7bf043 req-87d84996-8407-4096-8090-061037e51707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9266b7-e9b6-4a12-b3c5-150b3874e80c", "name": "network-vif-plugged", "status": "completed", "tag": "e549187a-8ace-4b54-9be7-6834bb57c0d8"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:01:26.935079 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-1aa3ac17-a296-4f48-90f5-7a418c7bf043 req-87d84996-8407-4096-8090-061037e51707 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:26.935537 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-1aa3ac17-a296-4f48-90f5-7a418c7bf043 req-87d84996-8407-4096-8090-061037e51707 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:26.947323 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-1aa3ac17-a296-4f48-90f5-7a418c7bf043 req-87d84996-8407-4096-8090-061037e51707 service nova] Creating event network-vif-plugged:e549187a-8ace-4b54-9be7-6834bb57c0d8 for instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c on hv-cinder-84067 May 12 15:01:26.950868 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [req-1aa3ac17-a296-4f48-90f5-7a418c7bf043 req-87d84996-8407-4096-8090-061037e51707 service nova] [52940c07-6442-4541-94a8-83f5ef01d3e4] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 15:01:27.657820 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:27.658766 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:27.669905 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:27.670656 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:27.671972 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:27.672687 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:27.817755 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:27.826055 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8d9b4288-a0fb-430f-91e6-99a65b4d088f tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.174772 May 12 15:01:27.826664 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 601/1207] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:27 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:27.961114 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [req-1aa3ac17-a296-4f48-90f5-7a418c7bf043 req-87d84996-8407-4096-8090-061037e51707 service nova] [52940c07-6442-4541-94a8-83f5ef01d3e4] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36236. May 12 15:01:27.965031 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-1aa3ac17-a296-4f48-90f5-7a418c7bf043 req-87d84996-8407-4096-8090-061037e51707 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.042533 May 12 15:01:27.965741 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 607/1208] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:01:28.842644 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:28.843270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:28.850304 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:28.850739 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:28.851501 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:28.851958 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:28.997300 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:29.005239 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-2817e14a-0b57-4511-be4e-24eaa146e2bd tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1266 microversion: 2.1 time: 0.166614 May 12 15:01:29.006214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 602/1209] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:28 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:30.030157 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:30.030976 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:30.046162 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:30.046692 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:30.047612 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:30.048161 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:30.202280 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:30.210295 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-2d64561d-8b24-415b-ad14-556981cfd280 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1452 microversion: 2.1 time: 0.185684 May 12 15:01:30.210874 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 608/1210] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:30 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:30.226613 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:01:30.227224 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:01:30.234692 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:30.235138 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:30.235967 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:30.236369 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:30.371132 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:01:30.379527 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-3f67dcf6-e645-4eb5-8e12-6de96c86f2bf tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1452 microversion: 2.1 time: 0.156910 May 12 15:01:30.380163 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 603/1211] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:01:30 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:01:32.406984 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-f03a46b4-8b50-4111-a671-bf0da0ed4c56 req-f7f3a3cb-bb0f-4e7a-8afc-5c1b0f2c17de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9266b7-e9b6-4a12-b3c5-150b3874e80c", "tag": "e549187a-8ace-4b54-9be7-6834bb57c0d8"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:01:32.416726 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-f03a46b4-8b50-4111-a671-bf0da0ed4c56 req-f7f3a3cb-bb0f-4e7a-8afc-5c1b0f2c17de service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:01:32.417281 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-f03a46b4-8b50-4111-a671-bf0da0ed4c56 req-f7f3a3cb-bb0f-4e7a-8afc-5c1b0f2c17de service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:01:32.428427 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-f03a46b4-8b50-4111-a671-bf0da0ed4c56 req-f7f3a3cb-bb0f-4e7a-8afc-5c1b0f2c17de service nova] Creating event network-changed:e549187a-8ace-4b54-9be7-6834bb57c0d8 for instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c on hv-cinder-84067 May 12 15:01:32.433625 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-f03a46b4-8b50-4111-a671-bf0da0ed4c56 req-f7f3a3cb-bb0f-4e7a-8afc-5c1b0f2c17de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030324 May 12 15:01:32.434297 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 609/1212] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:03:21.361656 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 12 15:03:21.366397 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-8f353415-7bcd-4027-b65e-1407d44aa0e8 req-662d9e94-7f3e-468e-b11f-56b2963648c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9266b7-e9b6-4a12-b3c5-150b3874e80c", "tag": "e549187a-8ace-4b54-9be7-6834bb57c0d8"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:03:21.372241 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:21.372759 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:21.375667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-8f353415-7bcd-4027-b65e-1407d44aa0e8 req-662d9e94-7f3e-468e-b11f-56b2963648c9 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:21.375667 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-8f353415-7bcd-4027-b65e-1407d44aa0e8 req-662d9e94-7f3e-468e-b11f-56b2963648c9 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:21.378919 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:21.379567 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:21.380399 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:21.380851 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:21.387434 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-8f353415-7bcd-4027-b65e-1407d44aa0e8 req-662d9e94-7f3e-468e-b11f-56b2963648c9 service nova] Creating event network-changed:e549187a-8ace-4b54-9be7-6834bb57c0d8 for instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c on hv-cinder-84067 May 12 15:03:21.392719 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-8f353415-7bcd-4027-b65e-1407d44aa0e8 req-662d9e94-7f3e-468e-b11f-56b2963648c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032733 May 12 15:03:21.393535 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 610/1213] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 15:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:03:21.407589 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:03:21.491380 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-8d22b942-3d9b-41d3-93b5-77501354bb79 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 204 len: 0 microversion: 2.1 time: 0.135362 May 12 15:03:21.492520 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 604/1214] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 15:03:21 2022] DELETE /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:03:21.501236 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:21.501931 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:21.508686 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:21.509061 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:21.509838 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:21.510266 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:21.947363 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:03:21.955043 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-92af4f5d-3d31-4107-9dba-285b3adc53de tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1576 microversion: 2.1 time: 0.458240 May 12 15:03:21.955620 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 611/1215] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:21 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1576 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:03:22.973499 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:22.974279 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:22.980601 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:22.981050 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:22.981818 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:22.982253 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:23.193590 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:03:23.205018 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-18fcd1ca-05c0-4da9-836a-c2e287471083 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1576 microversion: 2.1 time: 0.235781 May 12 15:03:23.205806 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 605/1216] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:22 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:03:23.858395 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-b2446bc9-75f0-432b-bfae-661d05c84583 req-e00bc41f-0b98-4957-9507-c5139ce645e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9266b7-e9b6-4a12-b3c5-150b3874e80c", "name": "network-vif-deleted", "tag": "e549187a-8ace-4b54-9be7-6834bb57c0d8"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:03:23.872762 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] [81b1a2d2-e110-491f-9aab-103b3d765580] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36294. May 12 15:03:23.878563 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-b2446bc9-75f0-432b-bfae-661d05c84583 req-e00bc41f-0b98-4957-9507-c5139ce645e6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:23.879019 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-b2446bc9-75f0-432b-bfae-661d05c84583 req-e00bc41f-0b98-4957-9507-c5139ce645e6 service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:23.891903 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-b2446bc9-75f0-432b-bfae-661d05c84583 req-e00bc41f-0b98-4957-9507-c5139ce645e6 service nova] Creating event network-vif-deleted:e549187a-8ace-4b54-9be7-6834bb57c0d8 for instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c on hv-cinder-84067 May 12 15:03:23.898285 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-b2446bc9-75f0-432b-bfae-661d05c84583 req-e00bc41f-0b98-4957-9507-c5139ce645e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043625 May 12 15:03:23.898887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 612/1217] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 15:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:03:24.222868 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:24.223985 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:24.231575 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:24.232059 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:24.232964 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:24.233423 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:24.302459 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:03:24.310478 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-89b92965-6b29-4c3f-883e-d23854717fa3 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 200 len: 1225 microversion: 2.1 time: 0.091575 May 12 15:03:24.318346 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 606/1218] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:24 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:03:25.328184 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:25.328882 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: ac9266b7-e9b6-4a12-b3c5-150b3874e80c] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:25.336304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:25.336752 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:25.337532 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:25.337963 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:25.354388 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] HTTP exception thrown: Instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c could not be found. May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Request method failure captured: May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c HTTP/1.1 May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifR_09h-AOYBlvqlq4K3f8A5oE1mxK6E6aP2xpkxgFHOAeST6tLOrZWVJPQ97IGgSVWPKsBB_8W6e9bv399KrPGWpHfzTeZQwjcGoJSRxneT4YhOETJGG2eKEJnP2bChWsh2aTcI0X-W2ZvaTJcdKar7R7L4EZM2stHH-n57pkbI_-Xk May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 15:03:25.356081 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f03df9aaaa743058d78385df499c624", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f03df9aaaa743058d78385df499c624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: dcf927fe5196454e96ab65e6cda3e1b8 May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c could not be found. May 12 15:03:25.357991 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'ac9266b7-e9b6-4a12-b3c5-150b3874e80c'} May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c could not be found. May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:03:25.358953 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c could not be found. May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c could not be found. May 12 15:03:25.360580 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:25.361972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Returning 404 to user: Instance ac9266b7-e9b6-4a12-b3c5-150b3874e80c could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:03:25.361972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-6247f96f-5687-4864-96df-0000c550fc47 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c" status: 404 len: 111 microversion: 2.1 time: 0.033613 May 12 15:03:25.361972 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 613/1219] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:25 2022] GET /compute/v2.1/servers/ac9266b7-e9b6-4a12-b3c5-150b3874e80c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:03:28.802867 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:28.803398 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:28.810064 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:28.810501 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:28.811471 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:28.811766 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:28.842697 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Going to try to terminate instance {{(pid=123726) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:03:28.902947 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [req-2145b92f-d031-4d45-805c-2109f6be7161 req-cd85c10c-a9ef-4fa5-8d39-20d8a7d8396f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67475bb-f5a8-4429-91ca-5e8ee942cb10", "tag": "bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6"}]} {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:03:28.912053 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-2145b92f-d031-4d45-805c-2109f6be7161 req-cd85c10c-a9ef-4fa5-8d39-20d8a7d8396f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:28.912494 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [req-2145b92f-d031-4d45-805c-2109f6be7161 req-cd85c10c-a9ef-4fa5-8d39-20d8a7d8396f service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:28.925466 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.compute.server_external_events [req-2145b92f-d031-4d45-805c-2109f6be7161 req-cd85c10c-a9ef-4fa5-8d39-20d8a7d8396f service nova] Creating event network-changed:bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6 for instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 on hv-cinder-84067 May 12 15:03:28.926726 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-6d7c9dd2-00cc-46de-bfca-1a3bed4ff486 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 204 len: 0 microversion: 2.1 time: 0.127465 May 12 15:03:28.927417 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 607/1220] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 15:03:28 2022] DELETE /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:03:28.931920 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [req-2145b92f-d031-4d45-805c-2109f6be7161 req-cd85c10c-a9ef-4fa5-8d39-20d8a7d8396f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129789 May 12 15:03:28.933152 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 614/1221] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 15:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:03:28.937574 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:28.938376 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:28.944405 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:28.944956 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:28.945792 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:28.946285 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:29.091131 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.policy [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123726) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:03:29.099539 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-c08fa58b-1ab4-43c6-9d03-efdbd77e1fb4 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1578 microversion: 2.1 time: 0.166781 May 12 15:03:29.100174 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 608/1222] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:28 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:03:30.119610 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:30.120222 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:30.126883 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:30.127302 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:30.128124 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:30.128561 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:30.333142 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:03:30.341192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-f5ee4c2c-509c-44dc-9b06-27609131829d tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1578 microversion: 2.1 time: 0.226429 May 12 15:03:30.341893 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 615/1223] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:30 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:03:31.329067 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [req-5e823ec2-a955-48bc-8dd6-e1f5d3cbe165 req-1a961532-37dc-4dea-b23b-4c61924dd67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67475bb-f5a8-4429-91ca-5e8ee942cb10", "name": "network-vif-deleted", "tag": "bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6"}]} {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:03:31.337667 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-5e823ec2-a955-48bc-8dd6-e1f5d3cbe165 req-1a961532-37dc-4dea-b23b-4c61924dd67e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:31.338101 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [req-5e823ec2-a955-48bc-8dd6-e1f5d3cbe165 req-1a961532-37dc-4dea-b23b-4c61924dd67e service nova] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:31.349851 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.compute.server_external_events [req-5e823ec2-a955-48bc-8dd6-e1f5d3cbe165 req-1a961532-37dc-4dea-b23b-4c61924dd67e service nova] Creating event network-vif-deleted:bbf33cf3-8bb6-4e77-a9d3-fa7940a1ada6 for instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 on hv-cinder-84067 May 12 15:03:31.355012 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [req-5e823ec2-a955-48bc-8dd6-e1f5d3cbe165 req-1a961532-37dc-4dea-b23b-4c61924dd67e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029577 May 12 15:03:31.356265 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 609/1224] 10.222.0.79 () {64 vars in 1317 bytes} [Thu May 12 15:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:03:31.359528 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:31.360186 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:31.366632 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:31.367090 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:31.367887 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:31.368300 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:31.439299 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.policy [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf927fe5196454e96ab65e6cda3e1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f03df9aaaa743058d78385df499c624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123725) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:03:31.446804 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-045754f4-8464-4ebd-a169-d7f905c4b595 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 200 len: 1225 microversion: 2.1 time: 0.091152 May 12 15:03:31.447384 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 616/1225] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:31 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:03:32.470172 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:32.471339 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: a67475bb-f5a8-4429-91ca-5e8ee942cb10] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:32.482195 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:32.482939 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:32.484214 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:32.484655 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:32.498157 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] HTTP exception thrown: Instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 could not be found. May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Request method failure captured: May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 HTTP/1.1 May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifR_09h-AOYBlvqlq4K3f8A5oE1mxK6E6aP2xpkxgFHOAeST6tLOrZWVJPQ97IGgSVWPKsBB_8W6e9bv399KrPGWpHfzTeZQwjcGoJSRxneT4YhOETJGG2eKEJnP2bChWsh2aTcI0X-W2ZvaTJcdKar7R7L4EZM2stHH-n57pkbI_-Xk May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 15:03:32.499834 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f03df9aaaa743058d78385df499c624", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f03df9aaaa743058d78385df499c624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: dcf927fe5196454e96ab65e6cda3e1b8 May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 could not be found. May 12 15:03:32.501659 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'a67475bb-f5a8-4429-91ca-5e8ee942cb10'} May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 could not be found. May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:03:32.502648 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 could not be found. May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 could not be found. May 12 15:03:32.504298 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:32.506187 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Returning 404 to user: Instance a67475bb-f5a8-4429-91ca-5e8ee942cb10 could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:03:32.506187 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-de731955-9d64-4b3b-9ab4-c9a9d2d68b54 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10" status: 404 len: 111 microversion: 2.1 time: 0.039331 May 12 15:03:32.506187 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 610/1226] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:32 2022] GET /compute/v2.1/servers/a67475bb-f5a8-4429-91ca-5e8ee942cb10 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:03:32.980517 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:32.981069 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.compute.api [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123725) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:32.987523 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:32.987998 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:32.988761 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:32.989197 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG oslo_concurrency.lockutils [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:33.002798 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.wsgi [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] HTTP exception thrown: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Request method failure captured: May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: request: DELETE /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e HTTP/1.1 May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept: application/json May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Accept-Encoding: identity May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Connection: close May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Length: 0 May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Content-Type: application/json May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Host: 10.222.0.79 May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Openstack-System-Scope: None May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: User-Agent: python-urllib3/1.26.9 May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Auth-Token: gAAAAABifR_09h-AOYBlvqlq4K3f8A5oE1mxK6E6aP2xpkxgFHOAeST6tLOrZWVJPQ97IGgSVWPKsBB_8W6e9bv399KrPGWpHfzTeZQwjcGoJSRxneT4YhOETJGG2eKEJnP2bChWsh2aTcI0X-W2ZvaTJcdKar7R7L4EZM2stHH-n57pkbI_-Xk May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Id: None May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Domain-Name: None May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Identity-Status: Confirmed May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Is-Admin-Project: True May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Id: default May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Domain-Name: Default May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Project-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Role: reader,member May 12 15:03:33.004546 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Roles: reader,member May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f03df9aaaa743058d78385df499c624", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f03df9aaaa743058d78385df499c624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-Tenant-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Id: default May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Domain-Name: Default May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Id: dcf927fe5196454e96ab65e6cda3e1b8 May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: X-User-Name: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: method: > May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: exception: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.006318 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: action_args: {'id': 'da8da009-6bac-41a0-beae-ef20901cec9e'} May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:03:33.007192 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.008607 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: ERROR nova.api.openstack.wsgi May 12 15:03:33.010001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Returning 404 to user: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. {{(pid=123725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:03:33.010001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ae5f2ace-c8f0-470b-8aa0-29b6e3b13a46 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "DELETE /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 404 len: 111 microversion: 2.1 time: 0.029449 May 12 15:03:33.010001 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 617/1227] 10.222.0.79 () {58 vars in 1238 bytes} [Thu May 12 15:03:32 2022] DELETE /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:03:33.014864 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '>' {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:33.015510 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.compute.api [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] [instance: da8da009-6bac-41a0-beae-ef20901cec9e] Fetching instance by UUID {{(pid=123726) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:03:33.022032 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:33.022476 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:33.023244 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:03:33.023671 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG oslo_concurrency.lockutils [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Lock "7b6a5814-8930-4726-ad38-75a9ded38aa1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:03:33.037464 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.wsgi [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] HTTP exception thrown: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Request method failure captured: May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: request: GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e HTTP/1.1 May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept: application/json May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Accept-Encoding: identity May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Connection: close May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Length: 0 May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Content-Type: application/json May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Host: 10.222.0.79 May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Openstack-System-Scope: None May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: User-Agent: python-urllib3/1.26.9 May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Auth-Token: gAAAAABifR_09h-AOYBlvqlq4K3f8A5oE1mxK6E6aP2xpkxgFHOAeST6tLOrZWVJPQ97IGgSVWPKsBB_8W6e9bv399KrPGWpHfzTeZQwjcGoJSRxneT4YhOETJGG2eKEJnP2bChWsh2aTcI0X-W2ZvaTJcdKar7R7L4EZM2stHH-n57pkbI_-Xk May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Id: None May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Domain-Name: None May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Identity-Status: Confirmed May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Is-Admin-Project: True May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Id: default May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Domain-Name: Default May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Project-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Role: reader,member May 12 15:03:33.039014 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Roles: reader,member May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f03df9aaaa743058d78385df499c624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f03df9aaaa743058d78385df499c624", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f03df9aaaa743058d78385df499c624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Id: 2f03df9aaaa743058d78385df499c624 May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-Tenant-Name: tempest-TestVolumeBootPattern-1510473149 May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Id: default May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Domain-Name: Default May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Id: dcf927fe5196454e96ab65e6cda3e1b8 May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: X-User-Name: tempest-TestVolumeBootPattern-1510473149-project May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: method: > May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: exception: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.041255 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: action_args: {'id': 'da8da009-6bac-41a0-beae-ef20901cec9e'} May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: {{(pid=123726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:03:33.042270 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. May 12 15:03:33.044538 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: ERROR nova.api.openstack.wsgi May 12 15:03:33.048774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: DEBUG nova.api.openstack.wsgi [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Returning 404 to user: Instance da8da009-6bac-41a0-beae-ef20901cec9e could not be found. {{(pid=123726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:03:33.048774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO nova.api.openstack.requestlog [None req-4f9c1986-0595-428a-aced-c199880e5667 tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e" status: 404 len: 111 microversion: 2.1 time: 0.029855 May 12 15:03:33.048774 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: [pid: 123726|app: 0|req: 611/1228] 10.222.0.79 () {58 vars in 1235 bytes} [Thu May 12 15:03:33 2022] GET /compute/v2.1/servers/da8da009-6bac-41a0-beae-ef20901cec9e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:03:34.355614 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: DEBUG nova.api.openstack.wsgi [None req-ea61ce82-9180-48f7-9582-fcf9ba25fb6b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] Calling method '.version_select at 0x7f4650b20310>' {{(pid=123725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:03:34.382304 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO nova.api.openstack.requestlog [None req-ea61ce82-9180-48f7-9582-fcf9ba25fb6b tempest-TestVolumeBootPattern-1510473149 tempest-TestVolumeBootPattern-1510473149-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1753658592" status: 202 len: 0 microversion: 2.1 time: 0.030569 May 12 15:03:34.383032 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: [pid: 123725|app: 0|req: 618/1229] 10.222.0.79 () {58 vars in 1262 bytes} [Thu May 12 15:03:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1753658592 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:04:13.771597 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:04:13.772651 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 15:04:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:04:31.548302 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:04:31.549215 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 15:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:04:38.188212 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:04:38.189135 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 15:04:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:06:02.344288 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:06:02.345390 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 15:06:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:06:18.105168 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:06:18.105846 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 15:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:06:36.809361 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:06:36.810002 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 15:06:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:07:33.784652 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:07:33.785737 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 15:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:07:51.561287 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:07:51.562374 dv-cinder-840678-8-iscsi devstack@n-api.service[123726]: Thu May 12 15:07:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:07:58.201172 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:07:58.201803 dv-cinder-840678-8-iscsi devstack@n-api.service[123725]: Thu May 12 15:07:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!